-- Logs begin at Tue 2022-05-24 09:20:25 UTC, end at Tue 2022-05-24 10:39:28 UTC. -- May 24 09:54:01.838329 dv-cinder-810457-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 24 09:54:01.845870 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 09:54:01 2022] *** May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: nodename: dv-cinder-810457-9-iscsi May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: machine: x86_64 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: clock source: unix May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: pcre jit disabled May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: detected number of CPU cores: 4 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: current working directory: / May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: detected binary path: /usr/bin/uwsgi-core May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: your processes number limit is 47680 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: your memory page size is 4096 bytes May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: detected max file descriptor number: 2048 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: lock engine: pthread robust mutexes May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: thunder lock: enabled May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: Python main interpreter initialized at 0x559b8cf3e9c0 May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: python threads support enabled May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: your server socket listen backlog is limited to 100 connections May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: your mercy for graceful operations on workers is 90 seconds May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: mapped 403077 bytes (393 KB) for 2 cores May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: *** Operational MODE: preforking *** May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: *** uWSGI is running in multiple interpreter mode *** May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: spawned uWSGI master process (pid: 80303) May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: spawned uWSGI worker 1 (pid: 80315, cores: 1) May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: spawned uWSGI worker 2 (pid: 80316, cores: 1) May 24 09:54:01.900394 dv-cinder-810457-9-iscsi devstack@keystone.service[80303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 09:54:01.898159 dv-cinder-810457-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 24 09:54:07.585220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:54:07.585220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes May 24 09:54:07.586297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:54:07.586297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes May 24 09:54:07.586930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:54:07.586930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes May 24 09:54:07.587386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 09:54:07.587386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes May 24 09:54:07.635748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:54:07.635951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:54:07.636148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] command line args: [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:54:07.636422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:54:07.636509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 09:54:07.636591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ================================================================================ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:54:07.636663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 09:54:07.636841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.636930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] command line args: [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 09:54:07.637089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config_dir = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.637170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 09:54:07.637277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.637358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ================================================================================ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 09:54:07.637466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] config_source = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.637547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.637657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] debug = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.637767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config_dir = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.637870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] config_source = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] debug = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.638925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_config_append = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_dir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.639974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_config_append = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_dir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.640969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.641962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.642932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.643085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.643170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.643331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.643588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.643676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.643755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] publish_errors = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] publish_errors = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.644889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] standard_threads = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.645949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] standard_threads = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_journal = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_json = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_stderr = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.646916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_journal = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.647037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] use_syslog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.647161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_json = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.647277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.647398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_stderr = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.647523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.647639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] use_syslog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.647753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.647886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 09:54:07.648002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.648117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.648245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.648374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.648632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.648827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.648952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.649919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.650989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.651973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.652988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.653951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.654965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655459 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.655957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.656989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.657949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.658924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.659922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.660993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.661942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.662907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.663980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.664148 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.664339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.664534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.664722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.664856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.664977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.665926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.666887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.667962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.668908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.669980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.670936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.671914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.672971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.external = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.external = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.673916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.password = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.password = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.token = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.674928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.token = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.675968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.676942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.677989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.678947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.679073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.679210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.679330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.679447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.679571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.680929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.681902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.682978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.683960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.684909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.685984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.686928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.687923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.688885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.689955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.690901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.691886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.692285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.692403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.692520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.692636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.692765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.692885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.693948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.694913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.695031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.695160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.695296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.695993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.696764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.697938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.698859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.699958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.700890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.701953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.702992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.703954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.704903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.705951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.706890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.707988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.708931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.709876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.710841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.711918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.712884 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.713951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.714896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.715919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.716876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.717956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.718901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.719982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.720946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.721914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.722949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.723920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.724887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.725880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:54:07.726101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.726101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.726101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 09:54:07.726101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 09:54:07.753626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.753859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.753949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.754087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.754175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.754386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.762910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.763105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.791982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.792173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.792259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.792406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.844945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.845263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.896480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.896708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.897172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.897411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.963483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.963622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.963774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.963879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.964914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.988210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.988445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.988574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.988658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.988814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.988899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:07.989902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.001402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.001559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.014245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.014484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.014710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.014936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.015155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.015371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.015587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.015929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.016172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.016399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.016619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.016833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.017045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.017304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 24 09:54:08.034680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.034889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:54:08.035105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.035228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.035310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:54:08.035430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:54:08.035643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.035727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.035869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 24 09:54:08.035952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.036143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.036224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.036405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.036488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.036663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.036919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.048045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.048320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.048590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.048674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.048870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.048953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.049196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.049482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.057096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.057798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.060396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.060677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.060959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.061104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.061239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.061386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.061516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.061667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.061887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.061968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.062978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.063080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.063246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.063353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.063626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.063929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.090725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.091394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.092496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.092779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.093091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.093484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.098080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.098355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.098636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.098802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.099084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.099371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.106341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.106623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.106916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.107202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.111125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.111520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.111744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.111852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.112882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.113032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.113149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.113324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.113594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.113871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.132194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.132472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.133246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.133526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.137176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.138229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.140819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.141115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.141909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.142203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.146162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.147345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.150394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.151586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.154204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.154500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.154779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.155066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.155295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.155377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.155597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.155680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.156021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.156315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.156606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.156891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.174688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.174970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.175237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.175500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.176025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.176311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.176577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.176840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.184109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.185451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.185810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.186088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.187437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.189164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.189448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.189730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.190008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.190281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.190524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.190805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.191090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.191373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.191651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.204789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.205092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.205381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.205660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.205934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.206147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.206280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.206415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.206557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.206691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.206958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.207238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.207528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.207830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.224938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.225799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.228332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.229390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.231641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.232736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.233283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.234362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.234926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.235211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.235495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.236026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.236318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.236602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.243545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.244539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.245203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.246150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.248481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.248776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.249058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.249334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.249484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.249773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.250055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.250329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.259104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.259389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.259775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.260044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.260330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.260609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.267671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.267971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.268249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.268521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.268633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 24 09:54:08.268794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.268915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.269883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.270949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.271112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.271219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.271381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.271648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.271943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.272205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 24 09:54:08.310793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559b8cf3e9c0 pid: 80316 (default app) May 24 09:54:08.311397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559b8cf3e9c0 pid: 80315 (default app) May 24 09:54:08.314058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4f25-abe2-4bed-a3f0-81b6c8413efe None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:08.314361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4f25-abe2-4bed-a3f0-81b6c8413efe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:08.314641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4f25-abe2-4bed-a3f0-81b6c8413efe None None] PATH_INFO: `/v3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:08.318925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Tue May 24 09:54:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:16.977575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:16.978142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:16.978142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:16.982516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:16.987583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62605-d30f-436b-a50a-138258c56677 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:16.988015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62605-d30f-436b-a50a-138258c56677 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:16.988168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62605-d30f-436b-a50a-138258c56677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:17.056519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: INFO dbcounter [None req-5de62605-d30f-436b-a50a-138258c56677 None None] Registered counter for database keystone May 24 09:54:17.077771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG oslo_db.sqlalchemy.engines [None req-5de62605-d30f-436b-a50a-138258c56677 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:54:17.083894 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writer thread running {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 09:54:17.260041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-5de62605-d30f-436b-a50a-138258c56677 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 24 09:54:17.260398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-5de62605-d30f-436b-a50a-138258c56677 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 24 09:54:17.316227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5de62605-d30f-436b-a50a-138258c56677 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:17.317832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5de62605-d30f-436b-a50a-138258c56677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:17.441599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 24 09:54:17.598348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:17.667039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: INFO dbcounter [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] Registered counter for database keystone May 24 09:54:17.686513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG oslo_db.sqlalchemy.engines [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 09:54:17.692658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writer thread running {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 09:54:17.813338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4504c-efcc-48a8-8afe-91f9887c336c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:17.817620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:17.818285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:17.818574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:17.818853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:17.827119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:17.879364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING keystone.common.rbac_enforcer.enforcer [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 24 09:54:17.879655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ee7ab-d4f3-4470-87e7-49b20348b553 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:17.889222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Tue May 24 09:54:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 09:54:17.895194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62605-d30f-436b-a50a-138258c56677 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:17.909898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62605-d30f-436b-a50a-138258c56677 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:17.915035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:17.916179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:17.916467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:17.916742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] PATH_INFO: `/v3/projects/fdda7d022db54add9754a061e49ddfb7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:17.918238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=fdda7d022db54add9754a061e49ddfb7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:18.078069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 24 09:54:18.078722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8638e-acf3-4c11-aadb-9281fbc8cfc0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:18.083066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Tue May 24 09:54:17 2022] GET /identity/v3/projects/fdda7d022db54add9754a061e49ddfb7 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:20.240334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5c1-aad6-4bed-a5b6-ae2a8c6bb767 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:20.240876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5c1-aad6-4bed-a5b6-ae2a8c6bb767 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:20.240876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b5c1-aad6-4bed-a5b6-ae2a8c6bb767 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:20.245478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:54:20.250902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:20.251278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:20.251457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:20.270573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:20.272121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:20.279837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 24 09:54:20.301395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b5c1-aad6-4bed-a5b6-ae2a8c6bb767 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:20.313798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b5c1-aad6-4bed-a5b6-ae2a8c6bb767 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:20.317936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c33988-56e7-445b-9c0c-77fa7c20afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:20.318557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33988-56e7-445b-9c0c-77fa7c20afb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:20.318840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33988-56e7-445b-9c0c-77fa7c20afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:20.319116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33988-56e7-445b-9c0c-77fa7c20afb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:20.327615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c33988-56e7-445b-9c0c-77fa7c20afb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:20.329442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c33988-56e7-445b-9c0c-77fa7c20afb9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:20.338222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Tue May 24 09:54:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 09:54:20.343346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:20.352409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63e54d-5a74-4a8c-83c8-5819b840fd2c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:20.356740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7060389-7d58-4bfb-9ddd-061d9732a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:20.357607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060389-7d58-4bfb-9ddd-061d9732a138 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:20.357893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060389-7d58-4bfb-9ddd-061d9732a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:20.358173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7060389-7d58-4bfb-9ddd-061d9732a138 admin admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:20.359546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060389-7d58-4bfb-9ddd-061d9732a138 admin admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:20.361408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7060389-7d58-4bfb-9ddd-061d9732a138 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:20.362952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Tue May 24 09:54:20 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:22.590381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64a9d-1045-42a0-b094-b01cd7929175 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:22.590917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64a9d-1045-42a0-b094-b01cd7929175 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:22.591010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64a9d-1045-42a0-b094-b01cd7929175 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:22.592333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:22.597485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:22.597929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:22.598055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:22.615096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:22.616312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:22.658666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720556a2-bc61-43fe-b1ea-51a1a2e32844 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:22.658954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720556a2-bc61-43fe-b1ea-51a1a2e32844 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:22.659237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720556a2-bc61-43fe-b1ea-51a1a2e32844 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:22.660604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:54:22.666166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:22.666457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:22.666742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:22.699290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:22.706880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80315) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 24 09:54:22.707326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80315) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 24 09:54:22.722223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:22.747348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:22.754807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:22.756464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:22.828700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f9b52-0684-499b-a687-b080f64523e8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:22.856634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:22.863446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:22.864283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:22.864574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:22.864858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:22.876883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:22.878941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:22.888690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:22.889788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:22.890801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:54:22.895548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:22.983817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:23.003010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b8d6c-e296-4320-b201-09003daf72d3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.040841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.041516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.041808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.042092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.042854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:23.043159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.044609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.057131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:23.062567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:23.093706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31b119-f262-4445-83da-caa382a7fb2d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.096032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:23.131050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.131979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.132875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.133155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.163979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d178bc-b3f4-4b32-a7ee-be5cdd0bc732 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.199880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.200767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.201054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.201162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.201329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.202545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.202634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.204037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.205664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 9/16] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:23 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:23.210970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:23.225577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:23.300832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 8/17] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:54:23.307112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:23.308754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e16ce7-74f5-4ab0-b9bb-7d6808cb69ee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.309905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:23.344161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.344951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.345232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.345506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.346672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.349257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.350985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:23.356809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:23.405334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81807781-469b-4e47-88a7-7f27701683a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.436876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:23.438939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.439736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.440043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.440317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.455740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a413c-c02f-412a-9010-060758f00cc6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.461568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.463058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:54:23.484030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:23.485025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:23.485849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:54:23.485849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:54:23.485849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:54:23.485849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:23.485849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:54:23.490935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:23.491215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.492628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.492914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.493196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.494036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.domain.id=default, user.id=a8aea1f45aa44e67a635de02ad254222) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:23.494353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.495827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f66253-cbc1-4643-bc9d-bb1df3624d44 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.502600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Tue May 24 09:54:23 2022] GET /identity/v3/role_assignments?user.id=a8aea1f45aa44e67a635de02ad254222&scope.domain.id=default&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:23.551571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:23.599381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e1e2-3f48-4927-a4ec-c3accca3cd6e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:23.635495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:23.636218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:23.636510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:23.636792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:23.637540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:23.637919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:23.639384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73163238-6852-4a88-a217-823c14f7eadf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:23.658234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:25.896944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901845c-92c0-4ff1-ba67-b3cd87f892f9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:25.897483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901845c-92c0-4ff1-ba67-b3cd87f892f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:25.897483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901845c-92c0-4ff1-ba67-b3cd87f892f9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:25.899184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:25.904833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:25.905273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:25.905444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:25.928868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:25.930891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:26.030053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:26.064912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901845c-92c0-4ff1-ba67-b3cd87f892f9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:26.224507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901845c-92c0-4ff1-ba67-b3cd87f892f9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:26.274715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf050-e616-49d1-9c0b-a82c6a0a6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:26.275522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf050-e616-49d1-9c0b-a82c6a0a6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.275821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf050-e616-49d1-9c0b-a82c6a0a6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.276108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf050-e616-49d1-9c0b-a82c6a0a6fb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.286826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cf050-e616-49d1-9c0b-a82c6a0a6fb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-868cf050-e616-49d1-9c0b-a82c6a0a6fb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:26.298802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:26.299682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:26.300479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 13/24] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:26.306475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:26.364355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887648bc-01ba-4c60-be62-d1d10dcb4c15 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.364677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887648bc-01ba-4c60-be62-d1d10dcb4c15 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.364916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887648bc-01ba-4c60-be62-d1d10dcb4c15 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.366400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 14/25] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:54:26.372022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.372607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.373083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.380092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:26.393216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:26.402779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:26.404154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:26.509862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c92ff-01c6-44b2-8a89-c672806576c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:26.557918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:26.558603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.558890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.559171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.559962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:26.560279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:26.561694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:26.582717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 15/26] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 24 09:54:26.592517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 12/27] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:26.598295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:26.635583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:26.822316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1d189-ee58-4bcc-9f45-9de53a9e7315 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:26.836883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880df97-3736-4cf3-8776-efa98330301a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:26.857260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:26.869867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9840136-cb66-45d9-a151-9d6277f9faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:26.877478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840136-cb66-45d9-a151-9d6277f9faa5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.877478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840136-cb66-45d9-a151-9d6277f9faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.877478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9840136-cb66-45d9-a151-9d6277f9faa5 None admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.877478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840136-cb66-45d9-a151-9d6277f9faa5 None admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:26.877977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9840136-cb66-45d9-a151-9d6277f9faa5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:26.880004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 16/28] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:26 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:26.881119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fa8b9-771f-497d-95c7-5fee1aa3367d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.881329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fa8b9-771f-497d-95c7-5fee1aa3367d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.881610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fa8b9-771f-497d-95c7-5fee1aa3367d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.883115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 17/29] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:26.888651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fa8b9-771f-497d-95c7-5fee1aa3367d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:26.905289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:26.912591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:26.913517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.913809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.914092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:26.936233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:26.937766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5ef64275-6aa7-4e22-9013-3286a31448c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:54:26.973453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:26.974517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:26.975531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:54:26.975531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:54:26.975531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:54:26.975531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:26.982049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 13/30] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:54:26.984728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:26.986258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:26.986699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.021240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:27.024459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:27.080708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fa8b9-771f-497d-95c7-5fee1aa3367d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:27.106124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 14/31] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:27.106997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:27.125987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04f177-9a59-4661-9ed3-8fe1894540e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:27.127187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04f177-9a59-4661-9ed3-8fe1894540e9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.127904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04f177-9a59-4661-9ed3-8fe1894540e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.128326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04f177-9a59-4661-9ed3-8fe1894540e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.129680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04f177-9a59-4661-9ed3-8fe1894540e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:27.131735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04f177-9a59-4661-9ed3-8fe1894540e9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:27.134265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 18/32] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:27.136293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34f86e-a070-4660-a04b-14c841886816 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.136731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34f86e-a070-4660-a04b-14c841886816 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.137156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34f86e-a070-4660-a04b-14c841886816 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.139507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 19/33] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:27.140452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34f86e-a070-4660-a04b-14c841886816 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:27.212457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:27.228335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89542-7df9-495e-8106-89a0b550f23d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:27.233854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:27.267433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34f86e-a070-4660-a04b-14c841886816 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:27.274442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:27.275121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.275409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.275690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.276502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:27.276854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:27.278839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:27.294152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 15/34] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:27.295134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:27.309409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04838c65-be75-4e5b-9123-ade51917cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:27.310767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838c65-be75-4e5b-9123-ade51917cd9a None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.311296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838c65-be75-4e5b-9123-ade51917cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.311767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838c65-be75-4e5b-9123-ade51917cd9a None admin] PATH_INFO: `/v3/domains/default/users/a8aea1f45aa44e67a635de02ad254222/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.314361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04838c65-be75-4e5b-9123-ade51917cd9a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a8aea1f45aa44e67a635de02ad254222, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:27.316293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04838c65-be75-4e5b-9123-ade51917cd9a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:27.411279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a65364-2154-4885-9d0a-7db0e19c4b40 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:27.455635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01d39c-a6a0-44da-ab38-19b178d758ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:27.456723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01d39c-a6a0-44da-ab38-19b178d758ab None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.457201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01d39c-a6a0-44da-ab38-19b178d758ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.457762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01d39c-a6a0-44da-ab38-19b178d758ab None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.458760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01d39c-a6a0-44da-ab38-19b178d758ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:27.461035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01d39c-a6a0-44da-ab38-19b178d758ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:27.515863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 20/35] 10.222.0.44 () {58 vars in 1361 bytes} [Tue May 24 09:54:27 2022] PUT /identity/v3/domains/default/users/a8aea1f45aa44e67a635de02ad254222/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:54:27.515863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.515863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.515863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.536137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:27.537842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:27.685553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 21/36] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:27.686136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:27.733373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 16/37] 10.222.0.44 () {60 vars in 1131 bytes} [Tue May 24 09:54:27 2022] POST /identity/v3/roles => generated 225 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:27.735257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23edbca-11d4-4bed-96ee-1d542a9c32eb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.735554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23edbca-11d4-4bed-96ee-1d542a9c32eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.736013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23edbca-11d4-4bed-96ee-1d542a9c32eb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.737577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 17/38] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:27.741856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23edbca-11d4-4bed-96ee-1d542a9c32eb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:27.760585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:27.789547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:27.847145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a97c-8a5f-4987-a6d4-82afdb55a4b8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:27.886518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f969945-35b2-4a9e-b6c8-06eaaa6df374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:27.887820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f969945-35b2-4a9e-b6c8-06eaaa6df374 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.888311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f969945-35b2-4a9e-b6c8-06eaaa6df374 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.888789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f969945-35b2-4a9e-b6c8-06eaaa6df374 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.888890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23edbca-11d4-4bed-96ee-1d542a9c32eb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:27.889827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f969945-35b2-4a9e-b6c8-06eaaa6df374 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:27.893123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f969945-35b2-4a9e-b6c8-06eaaa6df374 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:27.934356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a742d6-1937-4eba-b92a-551670062583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:27.935043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a742d6-1937-4eba-b92a-551670062583 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:27.935507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a742d6-1937-4eba-b92a-551670062583 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:27.935864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a742d6-1937-4eba-b92a-551670062583 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:27.936595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a742d6-1937-4eba-b92a-551670062583 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:27.938254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a742d6-1937-4eba-b92a-551670062583 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:28.030352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 22/39] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:54:27 2022] POST /identity/v3/projects => generated 301 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:28.031651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:28.032068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:28.032361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:28.051167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:28.052499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:28.061416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 18/40] 10.222.0.44 () {60 vars in 1131 bytes} [Tue May 24 09:54:27 2022] POST /identity/v3/roles => generated 219 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:28.062646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf47c-172f-45d4-b30b-10eb29d3b388 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:28.062942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf47c-172f-45d4-b30b-10eb29d3b388 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:28.063223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf47c-172f-45d4-b30b-10eb29d3b388 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:28.068215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 19/41] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:28.072320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:28.072732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:28.073049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:28.110337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:28.112047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:28.141157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 23/42] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:28.166022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:28.219892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:28.273260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:28.290728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:28.313019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:28.328309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1bfd2-8eca-4797-b9d8-171759d92c1c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:28.378190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:28.378689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:28.378979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:28.380012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:28.381942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:28.382186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:28.384129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 24/44] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:28.390360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:28.445297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac87e5e-1e51-4b5c-95c9-6b5db3e7180e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:28.484691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f10bd-8511-44e6-9cb5-4675ab018a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:28.485661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f10bd-8511-44e6-9cb5-4675ab018a91 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:28.485965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f10bd-8511-44e6-9cb5-4675ab018a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:28.486255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f10bd-8511-44e6-9cb5-4675ab018a91 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:28.487012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f10bd-8511-44e6-9cb5-4675ab018a91 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:28.488445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f10bd-8511-44e6-9cb5-4675ab018a91 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:28.497665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40086db4-379f-4833-80b8-5c42fe44ef76 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:28.508783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:28.531656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf830a-57bc-4c5c-b06a-dbb07d3fd6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:28.532341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf830a-57bc-4c5c-b06a-dbb07d3fd6f9 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:28.532628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf830a-57bc-4c5c-b06a-dbb07d3fd6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:28.532910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf830a-57bc-4c5c-b06a-dbb07d3fd6f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:28.533630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf830a-57bc-4c5c-b06a-dbb07d3fd6f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:28.535081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf830a-57bc-4c5c-b06a-dbb07d3fd6f9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:28.558594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 21/45] 10.222.0.44 () {60 vars in 1131 bytes} [Tue May 24 09:54:28 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:54:28.645274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 25/46] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:54:28 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:54:29.913490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629e20-cead-451d-855a-ac7be7749ec7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:29.914025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629e20-cead-451d-855a-ac7be7749ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:29.914112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629e20-cead-451d-855a-ac7be7749ec7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:29.915620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 22/47] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:29.920856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:29.921281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:29.921556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:29.938622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:29.939829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:30.005051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 26/48] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:30.028563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629e20-cead-451d-855a-ac7be7749ec7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:30.087932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:30.129470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629e20-cead-451d-855a-ac7be7749ec7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:30.162163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ca185-6065-452d-84c9-addb985f166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:30.162952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ca185-6065-452d-84c9-addb985f166b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.163349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ca185-6065-452d-84c9-addb985f166b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.163689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ca185-6065-452d-84c9-addb985f166b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.175402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ca185-6065-452d-84c9-addb985f166b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-787ca185-6065-452d-84c9-addb985f166b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:30.184916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:30.185820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:30.186783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 23/49] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:30.191948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:30.284588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:30.293559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8f422-2c09-4385-abf9-42d7b4477df4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:30.328108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:30.328765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.329048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.329324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.330075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:30.330382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:30.331828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:30.341227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 27/50] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:30.346690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ca185-6065-452d-84c9-addb985f166b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:30.449568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ca185-6065-452d-84c9-addb985f166b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:30.469783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:30.484108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:30.484986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.485271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.485546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.487334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:30.488835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:30.490486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 24/51] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:30 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:30.496313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:30.594197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4b49-3850-4aea-8d2e-6d12e45849a0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:30.627201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf89b17-ed1c-4677-b2d8-4bc615705232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:30.628020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89b17-ed1c-4677-b2d8-4bc615705232 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.628304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89b17-ed1c-4677-b2d8-4bc615705232 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.628576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf89b17-ed1c-4677-b2d8-4bc615705232 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.629726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf89b17-ed1c-4677-b2d8-4bc615705232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:30.631181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf89b17-ed1c-4677-b2d8-4bc615705232 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:30.633402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 28/52] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:30.639168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:30.737225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70531ff5-dee5-4b3f-820f-b967273776b2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:30.773976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:30.774633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.774918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.775191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.776052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.domain.id=default, user.id=a8aea1f45aa44e67a635de02ad254222) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:30.776362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:30.777805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a4fcf-9f02-483e-9bd8-079056169d04 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:30.788025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 25/53] 10.222.0.44 () {56 vars in 1322 bytes} [Tue May 24 09:54:30 2022] GET /identity/v3/role_assignments?user.id=a8aea1f45aa44e67a635de02ad254222&scope.domain.id=default&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:30.933291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff86e7-7831-450f-95be-9649c77547f5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.933812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff86e7-7831-450f-95be-9649c77547f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.933916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff86e7-7831-450f-95be-9649c77547f5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.935239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 29/54] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:30.940924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:30.941432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:30.941521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:30.959766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:30.961214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:31.008974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:31.028666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 26/55] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:31.051317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff86e7-7831-450f-95be-9649c77547f5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:31.075988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:31.150375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff86e7-7831-450f-95be-9649c77547f5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:31.183851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b090-56cf-4347-81c1-85261fccf745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:31.184636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b090-56cf-4347-81c1-85261fccf745 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:31.184923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b090-56cf-4347-81c1-85261fccf745 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:31.185201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b090-56cf-4347-81c1-85261fccf745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:31.186370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b090-56cf-4347-81c1-85261fccf745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:31.187840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b090-56cf-4347-81c1-85261fccf745 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:31.189421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 30/56] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:31.195133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:31.290601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9c09a-161b-4ea4-9580-18e6394b6e96 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:31.323112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745de99-23ad-469d-b319-169cb1e92802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:31.323765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745de99-23ad-469d-b319-169cb1e92802 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:31.324080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745de99-23ad-469d-b319-169cb1e92802 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:31.324360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745de99-23ad-469d-b319-169cb1e92802 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:31.325073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745de99-23ad-469d-b319-169cb1e92802 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:31.326536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745de99-23ad-469d-b319-169cb1e92802 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:31.409858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 27/57] 10.222.0.44 () {60 vars in 1140 bytes} [Tue May 24 09:54:31 2022] POST /identity/v3/projects => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:54:33.591490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94623-6154-420d-ac27-a715ace094ca None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:33.592015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94623-6154-420d-ac27-a715ace094ca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:33.592099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b94623-6154-420d-ac27-a715ace094ca None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:33.593446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 31/58] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:33.598566 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:33.598966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:33.599151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:33.616591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:33.617777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:33.643384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:33.683561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 28/59] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:33.707908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94623-6154-420d-ac27-a715ace094ca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:33.797321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:33.807212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b94623-6154-420d-ac27-a715ace094ca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:33.840587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62782265-65b7-479c-adb8-7726e0488e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:33.841366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782265-65b7-479c-adb8-7726e0488e0e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:33.841654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782265-65b7-479c-adb8-7726e0488e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:33.841929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62782265-65b7-479c-adb8-7726e0488e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:33.843092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62782265-65b7-479c-adb8-7726e0488e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:33.844555 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62782265-65b7-479c-adb8-7726e0488e0e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:33.846144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 32/60] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:33.851872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:33.948871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449dde-1fb8-4641-b545-0f36fee9652f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:33.981530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c6bc1-2002-4c3a-88f5-04a4d7966bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:33.982129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c6bc1-2002-4c3a-88f5-04a4d7966bdd None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:33.982419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c6bc1-2002-4c3a-88f5-04a4d7966bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:33.982758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c6bc1-2002-4c3a-88f5-04a4d7966bdd None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:33.983467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c6bc1-2002-4c3a-88f5-04a4d7966bdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:33.984956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c6bc1-2002-4c3a-88f5-04a4d7966bdd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:34.071304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 29/61] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:54:33 2022] POST /identity/v3/users => generated 275 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:37.215579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0732f2-4cae-4cf6-bb00-125dfd98e134 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.216153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0732f2-4cae-4cf6-bb00-125dfd98e134 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.216153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0732f2-4cae-4cf6-bb00-125dfd98e134 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.217541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 33/62] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:37.222813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.223208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.223400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.249003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:37.250216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:37.266624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:37.348666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 30/63] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:37.383244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0732f2-4cae-4cf6-bb00-125dfd98e134 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:37.545300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0732f2-4cae-4cf6-bb00-125dfd98e134 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:37.608524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd9e84-eaec-415e-a3a5-30a53e3b7179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:37.609704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd9e84-eaec-415e-a3a5-30a53e3b7179 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.610197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd9e84-eaec-415e-a3a5-30a53e3b7179 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.610699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd9e84-eaec-415e-a3a5-30a53e3b7179 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.626060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd9e84-eaec-415e-a3a5-30a53e3b7179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bbcd9e84-eaec-415e-a3a5-30a53e3b7179 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:37.634304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:37.635167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:37.635976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:37.642857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 34/64] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:37.645356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:37.665399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf140cc-1d54-41e1-bcc9-f4e79179472a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.665763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf140cc-1d54-41e1-bcc9-f4e79179472a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.666319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf140cc-1d54-41e1-bcc9-f4e79179472a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.668044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 35/65] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:54:37.675566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19713-8005-47aa-87f6-b3f2fc9cdb2d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.676778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19713-8005-47aa-87f6-b3f2fc9cdb2d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.677002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19713-8005-47aa-87f6-b3f2fc9cdb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.709672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9fb19713-8005-47aa-87f6-b3f2fc9cdb2d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:37.712605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9fb19713-8005-47aa-87f6-b3f2fc9cdb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:37.736834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:37.807012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 36/66] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:37.808761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d30fb-5e25-4514-972b-b46f824c24e4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.809328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d30fb-5e25-4514-972b-b46f824c24e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.809829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d30fb-5e25-4514-972b-b46f824c24e4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.811354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 37/67] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:37.817298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.817842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.818329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.826711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d96954-3035-434f-96db-d10bd81a6e0c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:37.839003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:37.840532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:37.863642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:37.864442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:37.864800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:37.865145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:37.866683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:37.867119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:37.868667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:37.877474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 31/68] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:37.878710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:37.896252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:37.918590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 38/69] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:37.919716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.002095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85690c9-269b-48f9-b0dd-74ef20867c8c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.007875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.030087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05665c-d7b5-4f01-b296-38f9d21a84d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.039077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f863068-6d31-4c31-bdf5-5d14d808d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.039924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863068-6d31-4c31-bdf5-5d14d808d188 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.040387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863068-6d31-4c31-bdf5-5d14d808d188 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.040806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f863068-6d31-4c31-bdf5-5d14d808d188 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.054326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f863068-6d31-4c31-bdf5-5d14d808d188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3f863068-6d31-4c31-bdf5-5d14d808d188 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:38.065632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:38.066496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:38.067279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 32/70] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:54:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:38.068470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6274e9d-58c0-43df-bffa-bd7599357b02 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.068470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6274e9d-58c0-43df-bffa-bd7599357b02 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.068700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6274e9d-58c0-43df-bffa-bd7599357b02 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.074976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 33/71] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:38.074976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6274e9d-58c0-43df-bffa-bd7599357b02 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.075181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae34022-c9b4-4ade-bd72-70daf8bfa271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.075181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34022-c9b4-4ade-bd72-70daf8bfa271 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.075181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34022-c9b4-4ade-bd72-70daf8bfa271 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.075181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34022-c9b4-4ade-bd72-70daf8bfa271 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.089342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae34022-c9b4-4ade-bd72-70daf8bfa271 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.090827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae34022-c9b4-4ade-bd72-70daf8bfa271 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.092771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 39/72] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:37 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.094014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.094312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.094590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.110759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:38.111968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:38.151282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.183545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 40/73] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:38.184671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6274e9d-58c0-43df-bffa-bd7599357b02 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.185736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.220337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.221139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.221431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.221718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.232202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:38.239992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:38.240861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 34/74] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:38.247028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.255298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.289181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b45934-9526-42ba-86a4-6ccd4385f3b7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.325426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.326028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.326321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.326606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.327354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:38.327667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.329101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45dcb4-2928-4814-8e71-c106b66a6e56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.337232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 41/75] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.338513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63643ac-43e6-47ec-b2ab-64dabacdea0c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.338805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63643ac-43e6-47ec-b2ab-64dabacdea0c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.339159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63643ac-43e6-47ec-b2ab-64dabacdea0c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.340416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 42/76] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:38.341176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63643ac-43e6-47ec-b2ab-64dabacdea0c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.348523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d609cf1-c853-45ee-8c5a-c5a6df61e793 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.377503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.382186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.382895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.386733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.386733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.442418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63643ac-43e6-47ec-b2ab-64dabacdea0c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.452648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.454133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.472065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.479872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.480666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.480954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.481227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.491970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:38.500395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:38.501444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:38.502262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 43/77] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:38.502890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.557048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 35/78] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:38.557899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.592275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.599870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b83d7-4e99-4548-a70a-c14a4dc65e99 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.632692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.633359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.633646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.633922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.634665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:38.634974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.636398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b66c66-2d0d-425c-b8d5-447d148908fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.644807 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 44/79] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.649514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.649806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.650089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.660225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62148698-f9ef-48ea-9002-6a78ca1a3dcd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.666174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:38.667351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:38.695119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.696057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.696345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.696624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.698084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.699538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.701201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 36/80] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.701970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.717437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.737629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 45/81] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:38.740645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.801060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.805243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774f4c-6aca-4498-905c-aaa301bdde21 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.840145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.840815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.841089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.841373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.842114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:38.842471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.843818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fab6-b078-468f-9861-48c675b3d382 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.852430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 37/82] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.853222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.884206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.885059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.885342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.885619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.886929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.888442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.890109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 46/83] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.890866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:38.939512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:38.954298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99caa9f-edcd-42f2-89b8-91f9546e002d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.987046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:38.987957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:38.988247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:38.988528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:38.989497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33937f09-1874-4fef-b361-7d12cab46fa0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:38.989727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:38.991883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:38.993517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 38/84] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:38.996653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.022993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.023635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.023956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.024232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.026766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.092766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.094146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.096569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d018e-00f2-44b0-a06a-4baf33e43c4f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.133362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.134156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.134441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.134718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.135917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.137377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.138988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 39/85] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:39.139742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.141374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.192745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 47/86] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:39.193662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.243148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.247368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c08f8-ad6d-4842-ba55-f41dab1d012f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.281468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.282338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.282623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.282896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.284181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.285634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.287254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 40/87] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:39.288067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.290368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1a3bd-abe4-49ac-8f0e-898c0a672634 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.324575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.325226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.325516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.325794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.326630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=0db87d6d048f40f4a549194f75eacc51) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:39.326944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.328442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.333796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 48/88] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/role_assignments?user.id=0db87d6d048f40f4a549194f75eacc51&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:39.334748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.350058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.414873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0a5c-7c1b-49af-9314-a2532434249a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.450861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a65567-1f50-4776-91bf-3e9d034ab193 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.458608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.459341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.460186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.460186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.490818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.492434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.492725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.493028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.493755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.495262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.501973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.537449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.539535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.576139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 49/89] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:54:39 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:39.579505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.653409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 41/90] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:39.654104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.676624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.718487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777fb25-ccf7-4a49-b0c7-e86ed91ac811 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.749029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:39.758241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.759131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.759687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.759819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.761141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.762648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.764853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 50/91] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:39.765722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.795744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da891f-67fc-4987-ba91-178799b2d497 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.848571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.849233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.849531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.849789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.893823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46832bac-a3a1-4e53-b68a-6b78915ecddc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:39.932375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.933688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:39.933824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.934534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:39.934817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:39.935096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:39.937203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:39.938722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:39.940729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 51/92] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:39.941339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:39.945173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:40.019369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:40.061091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042760e9-d5b7-4c8e-b47c-2235eb403965 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:40.062859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 42/93] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:40.063600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:40.108497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:40.109959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:40.110468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:40.111406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:40.112918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] RBAC: Adding query filter params (role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=0db87d6d048f40f4a549194f75eacc51) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:40.113603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:40.115622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:40.125042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 52/94] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:39 2022] GET /identity/v3/role_assignments?user.id=0db87d6d048f40f4a549194f75eacc51&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=d8c3658111d243bf9e85b889e49a811e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:40.126200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:40.212069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:40.238937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82a957-ebd3-40c6-ae79-618f78b6a7b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:40.256323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e5f63-055c-4f35-82b4-b41ab0b3bab5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:40.301969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:40.303688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:40.304269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:40.304725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] PATH_INFO: `/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:40.307120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] RBAC: Authorizing `identity:get_project(project_id=2484c3cbfcf14cacb47f8b410e9ce62b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:40.308864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:40.310841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 53/95] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:40 2022] GET /identity/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:40.316703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:40.330984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:40.332342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:40.332813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:40.333273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:40.334361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=a8aea1f45aa44e67a635de02ad254222) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:40.335559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:40.337264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e377f-4678-4651-aa50-63719824ec3b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:40.355456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 43/96] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:40 2022] GET /identity/v3/role_assignments?user.id=a8aea1f45aa44e67a635de02ad254222&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:40.455621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeb7ab-756e-4685-8adb-9a8ac74e8eae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:40.496422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:40.497023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:40.497311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:40.497592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:40.498462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=2484c3cbfcf14cacb47f8b410e9ce62b, user.id=0db87d6d048f40f4a549194f75eacc51) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:40.498778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:40.500380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04a687-5a20-4d88-9b5d-916ba26247d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:40.503834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:40.507905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 54/97] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:40 2022] GET /identity/v3/role_assignments?user.id=0db87d6d048f40f4a549194f75eacc51&scope.project.id=2484c3cbfcf14cacb47f8b410e9ce62b&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:41.785144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033cbf-4157-4e20-a7d2-08e6d311ec25 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:41.786145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033cbf-4157-4e20-a7d2-08e6d311ec25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:41.786647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6033cbf-4157-4e20-a7d2-08e6d311ec25 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:41.788865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 44/98] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:41.801415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:41.802310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:41.802789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:41.825193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:41.826689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:41.917043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 55/99] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:41.952247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6033cbf-4157-4e20-a7d2-08e6d311ec25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:41.989563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:42.073817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6033cbf-4157-4e20-a7d2-08e6d311ec25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:42.117263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:42.118440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.118942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.119452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.130526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:42.139648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:42.140536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:42.141287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:42.143643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 45/100] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:42.152940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:42.327721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ac612-65a8-4b42-811b-7ec0af04980d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:42.368598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:42.375005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:42.375678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.375991 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.376271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.377023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:42.377332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:42.378735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:42.391596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 56/101] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:42.397960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:42.516162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:42.529723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bca726-b10e-4109-b442-3d9f2a5f320c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:42.577030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:42.577987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.578216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.578494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.579712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:42.581221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:42.583173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 46/102] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:42 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:42.589360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:42.717517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204b4a6-e2b9-40e3-8b61-c56bca83ad22 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:42.763064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d689a-e1a3-485e-bce2-cf029419e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:42.764024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d689a-e1a3-485e-bce2-cf029419e02b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.764313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d689a-e1a3-485e-bce2-cf029419e02b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.764636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d689a-e1a3-485e-bce2-cf029419e02b None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.765843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d689a-e1a3-485e-bce2-cf029419e02b None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:42.767303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d689a-e1a3-485e-bce2-cf029419e02b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:42.769025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 57/103] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:42 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:42.775824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:42.898584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce95a5-6127-4a84-aba5-442db1dbb60e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:42.918116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46ed7f-e4cb-493d-a53a-43094f0bb239 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.918610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46ed7f-e4cb-493d-a53a-43094f0bb239 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46ed7f-e4cb-493d-a53a-43094f0bb239 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.920844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 58/104] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:42.931098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.931960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.932397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.964861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:42.966102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:42.972518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858886ef-b4bc-4534-8aac-82964aad9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:42.973446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858886ef-b4bc-4534-8aac-82964aad9ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:42.973740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858886ef-b4bc-4534-8aac-82964aad9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:42.974024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858886ef-b4bc-4534-8aac-82964aad9ee9 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/0db87d6d048f40f4a549194f75eacc51/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:42.980672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858886ef-b4bc-4534-8aac-82964aad9ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user_id=0db87d6d048f40f4a549194f75eacc51, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:42.982165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858886ef-b4bc-4534-8aac-82964aad9ee9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:43.063147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:43.078513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 47/105] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:42 2022] PUT /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/0db87d6d048f40f4a549194f75eacc51/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:54:43.079902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06b67-d317-4707-b982-a01fd78d106c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.080769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06b67-d317-4707-b982-a01fd78d106c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.081055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06b67-d317-4707-b982-a01fd78d106c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.082641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 48/106] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:43.083845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 59/107] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:43.088803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.089889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.089889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.109251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:43.110508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:43.131578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:43.139716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:43.298396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 49/108] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:43.346534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:43.383484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa7e3-2818-4864-98db-211414d34f83 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:43.481311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:43.482146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.482436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.482718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.516951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:43.525273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:43.526223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:54:43.527028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:43.529044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 60/109] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:43.534816 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:43.546168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bdc15-3f48-41ac-a87c-657504c1146c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:43.590494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:43.591704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.592165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.592593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.594645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:43.596490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:43.598431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 50/110] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:43.604201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:43.628197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:43.642369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:43.720766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa01ca6-c830-4730-aa30-1747fe22540c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:43.759650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:43.760704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.761297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.761781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.762725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:43.763314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:43.765071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212b0ab-a50b-40c3-85da-e9f2c32596d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:43.776138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 61/111] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:43.777790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eac99-bb54-4d76-bba3-35b71c4bdef8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.778265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eac99-bb54-4d76-bba3-35b71c4bdef8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.778756 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eac99-bb54-4d76-bba3-35b71c4bdef8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.780921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 62/112] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:43.781836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eac99-bb54-4d76-bba3-35b71c4bdef8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:43.870056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c89b-9388-4ede-a90e-72cb38aea69e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:43.906152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eac99-bb54-4d76-bba3-35b71c4bdef8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:43.921584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:43.945165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:43.945910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.946135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.946413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.946998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c553c-22e7-4fde-bd42-5e2a0e633853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:43.947475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:43.948559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c553c-22e7-4fde-bd42-5e2a0e633853 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.948965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:43.949240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c553c-22e7-4fde-bd42-5e2a0e633853 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.949691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c553c-22e7-4fde-bd42-5e2a0e633853 None admin] PATH_INFO: `/v3/users/89e648082a2448f498c32aa0fccab483` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.966737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c553c-22e7-4fde-bd42-5e2a0e633853 None admin] RBAC: Authorizing `identity:get_user(user_id=89e648082a2448f498c32aa0fccab483)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:43.969352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c553c-22e7-4fde-bd42-5e2a0e633853 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:43.971381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 63/113] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:43 2022] GET /identity/v3/users/89e648082a2448f498c32aa0fccab483 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:43.973031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e990-d0c2-4a48-881a-e58706b63972 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:43.973503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e990-d0c2-4a48-881a-e58706b63972 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:43.974119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e990-d0c2-4a48-881a-e58706b63972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:43.992410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e686e990-d0c2-4a48-881a-e58706b63972 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:43.994000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e686e990-d0c2-4a48-881a-e58706b63972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:44.059631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 51/114] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:54:43 2022] POST /identity/v3/projects => generated 302 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:54:44.066618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.084337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 64/115] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:44.086883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28249b-3cf0-45d8-bc2b-30613080092b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.087333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28249b-3cf0-45d8-bc2b-30613080092b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.087630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28249b-3cf0-45d8-bc2b-30613080092b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.089335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 65/116] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:44.102426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.102781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.103005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.129152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:44.130375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:44.242787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:44.281612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 66/117] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:44.282794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.292576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92def7ef-e0e5-49cd-8fbc-8d8c65dd77ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:44.332147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c566025-b390-4e30-9c7c-f95b23886339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:44.333139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566025-b390-4e30-9c7c-f95b23886339 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.333435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566025-b390-4e30-9c7c-f95b23886339 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.333757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566025-b390-4e30-9c7c-f95b23886339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.338957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:44.421612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4d90-375e-4b66-a0af-e55d00bd5511 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:44.423259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c566025-b390-4e30-9c7c-f95b23886339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:44.425751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c566025-b390-4e30-9c7c-f95b23886339 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:44.473690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b763d79-5486-4945-9b80-e1c0a63351d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:44.474522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b763d79-5486-4945-9b80-e1c0a63351d9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.474813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b763d79-5486-4945-9b80-e1c0a63351d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.475665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b763d79-5486-4945-9b80-e1c0a63351d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.488633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b763d79-5486-4945-9b80-e1c0a63351d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8b763d79-5486-4945-9b80-e1c0a63351d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:44.499065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:44.500187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:44.501140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 67/118] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:44.501779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ce3-7bac-4a8b-9be3-243680656a48 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.501845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ce3-7bac-4a8b-9be3-243680656a48 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.508039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8ce3-7bac-4a8b-9be3-243680656a48 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.508039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 68/119] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:44.508039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8ce3-7bac-4a8b-9be3-243680656a48 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:44.583189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 52/120] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:44.585287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.585599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.585863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.603010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:44.604237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:44.614983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:44.630930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8ce3-7bac-4a8b-9be3-243680656a48 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:44.677180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 53/121] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:44.683956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.688497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:44.689859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.690936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.691361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.709259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:44.723549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:44.724507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:44.726031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:44.728629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 69/122] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:44.729630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.814435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:44.819503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db9607-bd57-4b9a-b06a-35e06b1283d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:44.846262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78b816-4886-4567-84d8-1e3258e45029 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:44.866983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:44.868029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.868518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.868990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.870522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:44.871317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:44.873697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:44.884934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 54/123] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:44.885161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:44.886209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:44.886478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.886585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:44.886772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:44.888063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:44.889992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:44.896817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 70/124] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:44.898427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:44.923307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.023412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8f9b-0c13-442e-ab68-297478349f78 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.024051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df84fb-f035-45cf-92d8-f705940da211 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.067892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.068784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.069070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.069396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.072888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.074177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.074666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.075143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.076123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:45.076911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.078766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.082288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:45.088835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 71/125] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.089863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:45.090600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:45.091444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:45.092260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:45.096270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 55/126] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:45.102755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.126868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.200770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.212537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6bc41-6ad4-4d5e-aabe-518d9fb855bd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.224267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce3afd-6966-4a30-8a13-e00978dc7db1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.260058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.261242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.261729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.262185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.263202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] RBAC: Adding query filter params (role.id=66769d42dee44f55bf70f0358516a8d6, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=89e648082a2448f498c32aa0fccab483) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:45.263708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.264896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.265591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.265969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.266330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.266709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.268064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.269864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.272108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 72/127] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.273250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 56/128] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/role_assignments?user.id=89e648082a2448f498c32aa0fccab483&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=66769d42dee44f55bf70f0358516a8d6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.274312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.280055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.382164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.400990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d6127-e39d-4796-afb2-b62cc8f6abd2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.449144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.450717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.451183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.451623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.452674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:45.453223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.454877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.466159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 57/129] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.467657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.541973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d81807-bf69-4cd0-a2bb-f9aa859d0236 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.590840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50becf3e-5046-427d-a838-b44af9506dfb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.610567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.612106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.612597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.613074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.614848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.616950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.619171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 73/130] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.620204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.640766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.641697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.641989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.642272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.643483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.643607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.645258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.648291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 58/131] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.649187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.677210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.746513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8b17a-cc18-4ca5-9623-4ce8caa05252 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.787063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.788628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.789119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.790085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.791676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.793438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.795449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 74/132] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.796597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.865397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ed054-1793-4937-93a2-ebfb42860a23 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.904164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.905398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.905917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.906499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] PATH_INFO: `/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.907988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] RBAC: Authorizing `identity:get_project(project_id=2484c3cbfcf14cacb47f8b410e9ce62b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.909820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:45.911742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 59/133] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:45.912887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:45.921141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:45.938984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97846bfd-a028-461c-b511-e8c2a984e6b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:45.977483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:45.978391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:45.978661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:45.978938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/0db87d6d048f40f4a549194f75eacc51/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:45.981612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] RBAC: Authorizing `identity:create_grant(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user_id=0db87d6d048f40f4a549194f75eacc51, role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:45.983070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:46.006011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:46.026905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b7200-b1b8-4ef1-b90a-22362d304b50 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:46.061336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3e2e4-ea89-462d-b1a2-633845935b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:46.062135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e2e4-ea89-462d-b1a2-633845935b56 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.062426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e2e4-ea89-462d-b1a2-633845935b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.062708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3e2e4-ea89-462d-b1a2-633845935b56 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.063989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e2e4-ea89-462d-b1a2-633845935b56 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:46.065520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3e2e4-ea89-462d-b1a2-633845935b56 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:46.067402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 60/134] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:45 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:46.071427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccaf16-10fc-4cf6-855c-b376cc4290a3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.071427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccaf16-10fc-4cf6-855c-b376cc4290a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.071427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeccaf16-10fc-4cf6-855c-b376cc4290a3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.075525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 61/135] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:46.076447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccaf16-10fc-4cf6-855c-b376cc4290a3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:46.085000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 75/136] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:45 2022] PUT /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/0db87d6d048f40f4a549194f75eacc51/roles/d8c3658111d243bf9e85b889e49a811e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:54:46.085817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:46.212093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeccaf16-10fc-4cf6-855c-b376cc4290a3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:46.255097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0220c6-4b64-4fb6-ba3b-8c4197bce627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:46.257187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0220c6-4b64-4fb6-ba3b-8c4197bce627 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.257683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0220c6-4b64-4fb6-ba3b-8c4197bce627 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.258161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0220c6-4b64-4fb6-ba3b-8c4197bce627 None admin] PATH_INFO: `/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b/users/0db87d6d048f40f4a549194f75eacc51/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.259103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087d9de-0bdd-46fd-a6f2-95fd5c562094 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:46.261065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0220c6-4b64-4fb6-ba3b-8c4197bce627 None admin] RBAC: Authorizing `identity:create_grant(project_id=2484c3cbfcf14cacb47f8b410e9ce62b, user_id=0db87d6d048f40f4a549194f75eacc51, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:46.262887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0220c6-4b64-4fb6-ba3b-8c4197bce627 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:46.310110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:46.311152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.311602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.311839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/a8aea1f45aa44e67a635de02ad254222/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.314297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user_id=a8aea1f45aa44e67a635de02ad254222, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:46.315920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:46.370108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 62/137] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:46 2022] PUT /identity/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b/users/0db87d6d048f40f4a549194f75eacc51/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:54:46.371773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf04b-25fe-4249-9385-eff38d5503eb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.372299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf04b-25fe-4249-9385-eff38d5503eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.372785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf04b-25fe-4249-9385-eff38d5503eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.395702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ad6cf04b-25fe-4249-9385-eff38d5503eb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:46.397691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad6cf04b-25fe-4249-9385-eff38d5503eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:46.402734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:46.439505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 76/138] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:46 2022] PUT /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/a8aea1f45aa44e67a635de02ad254222/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:54:46.517698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 63/139] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:46.561284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:46.569886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:46.677460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bcaed-d418-4fec-b53e-a5e59041cf1d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.677809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bcaed-d418-4fec-b53e-a5e59041cf1d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.678036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bcaed-d418-4fec-b53e-a5e59041cf1d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.688491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 64/140] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:46.697762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.698083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.698332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.713862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33f1b-b943-47f8-814c-ae41f8001f82 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:46.726769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:46.728072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:46.770711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:46.770711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.770711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.770711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.796479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:46.805532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:46.806474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:46.807434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 77/141] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:46.812469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:46.884203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 65/142] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:46.906916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:46.954232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:46.956535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255640b4-3be1-4d82-8918-e1d86e7d5437 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:46.992132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:46.993117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:46.993409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:46.993693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:46.994457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:46.994770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:46.996186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:47.005055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 78/143] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:47.012657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:47.104055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:47.173770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad870dfd-702a-4c10-8811-8fc89b1ce2ca None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:47.183841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a8c83-826f-4765-b421-288cd5b405d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:47.224176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:47.252090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:47.253018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:47.253313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:47.253599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:47.254855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:47.256407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:47.258471 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 79/144] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:47 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:47.262266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:47.263093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:47.263445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:47.263985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:47.264990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:47.265098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:47.266506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:47.268502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 66/145] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:47.277053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:47.400454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2654b91-0bd9-4c1a-a0ac-07a8217a3c56 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:47.445736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:47.446344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:47.446655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:47.446920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:47.447977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:47.449521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:47.454045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90694d08-cb81-48e7-9b77-d2f9ef442ac0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:47.463912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:47.493568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:47.494717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:47.495204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:47.495763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:47.569731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:47.581474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:47.583501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:47.594240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 67/146] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:54:47 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:47.748251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 80/147] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:54:47.753960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:47.889047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008d497-aed5-4932-89ca-ed372be386c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:47.926029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c9450-3c74-4b2e-8117-929238a3c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:47.927293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c9450-3c74-4b2e-8117-929238a3c27c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:47.927776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c9450-3c74-4b2e-8117-929238a3c27c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:47.928842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c9450-3c74-4b2e-8117-929238a3c27c None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:47.930254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c9450-3c74-4b2e-8117-929238a3c27c None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:47.931957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c9450-3c74-4b2e-8117-929238a3c27c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:47.933863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 68/148] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:47 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:47.939743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:48.042236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:48.048739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8429edd-c97c-4223-a94f-c5af5d57f5b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:48.089198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:48.089870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:48.090153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:48.090430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:48.091281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=0db87d6d048f40f4a549194f75eacc51) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:48.091595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:48.093251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24df49-9acc-4e71-aafa-11c414d0aadd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:48.105781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 81/149] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:47 2022] GET /identity/v3/role_assignments?user.id=0db87d6d048f40f4a549194f75eacc51&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:48.282880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26a62-502d-4ce9-84ab-89864a75813d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:48.283412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26a62-502d-4ce9-84ab-89864a75813d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:48.283487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26a62-502d-4ce9-84ab-89864a75813d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:48.285005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 69/150] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:48.292320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:48.292906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:48.293417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:48.315336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:48.316918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:48.418140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 82/151] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:48.462883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26a62-502d-4ce9-84ab-89864a75813d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:48.552191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:48.600406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26a62-502d-4ce9-84ab-89864a75813d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:48.640869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:48.641683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:48.642025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:48.642444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:48.654562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:48.662795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:48.663708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:48.664552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 70/152] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:48.669852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:48.812973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:48.825218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbc685-5960-45fd-bcb1-b15285e6c8df None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:48.874712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:48.875390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:48.875678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:48.875986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:48.876747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:48.877059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:48.878472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:48.891669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 83/153] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:48.897863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:49.038894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50649368-4b36-4f93-bed5-7b2c360429cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:49.067830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:49.082845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8fab0-69b0-4249-bea4-64b9210f8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:49.092275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8fab0-69b0-4249-bea4-64b9210f8b50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.092275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8fab0-69b0-4249-bea4-64b9210f8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.092275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8fab0-69b0-4249-bea4-64b9210f8b50 None admin] PATH_INFO: `/v3/users/89e648082a2448f498c32aa0fccab483` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.092275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8fab0-69b0-4249-bea4-64b9210f8b50 None admin] RBAC: Authorizing `identity:get_user(user_id=89e648082a2448f498c32aa0fccab483)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:49.092275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8fab0-69b0-4249-bea4-64b9210f8b50 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:49.092275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 71/154] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:48 2022] GET /identity/v3/users/89e648082a2448f498c32aa0fccab483 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:49.094234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:49.194843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb318e-a719-492e-8ce6-aba5bdc1173a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.195132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb318e-a719-492e-8ce6-aba5bdc1173a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.195451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb318e-a719-492e-8ce6-aba5bdc1173a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.198012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 72/155] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:49.203344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.203635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.203960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.246292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:49.247866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:49.302163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da605c-006e-48c8-807a-72ef6163817d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:49.380529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:49.382120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.384618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.384618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.385868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:49.387359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:49.389140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 84/156] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:49 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:49.403431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 73/157] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:49.406422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:49.429186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:49.450228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:49.623587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81507b33-a52b-46be-85a6-b9be55e2900c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:49.641957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db6f9-7c3c-4521-a13f-2fc4c1e18ef0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:49.682980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf26b-ce23-4992-9dcf-b8ea3611888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:49.683902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf26b-ce23-4992-9dcf-b8ea3611888d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.684189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf26b-ce23-4992-9dcf-b8ea3611888d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.684464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf26b-ce23-4992-9dcf-b8ea3611888d None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/89e648082a2448f498c32aa0fccab483/roles/66769d42dee44f55bf70f0358516a8d6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.686829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf26b-ce23-4992-9dcf-b8ea3611888d None admin] RBAC: Authorizing `identity:create_grant(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user_id=89e648082a2448f498c32aa0fccab483, role_id=66769d42dee44f55bf70f0358516a8d6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:49.691820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf26b-ce23-4992-9dcf-b8ea3611888d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:49.699831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:49.720529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd619da-94e8-4ee6-bc7f-5d05764f1bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:49.721728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd619da-94e8-4ee6-bc7f-5d05764f1bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.722222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd619da-94e8-4ee6-bc7f-5d05764f1bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.722701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd619da-94e8-4ee6-bc7f-5d05764f1bb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.737205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd619da-94e8-4ee6-bc7f-5d05764f1bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-efd619da-94e8-4ee6-bc7f-5d05764f1bb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:49.756220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:49.757131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:49.757990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 74/158] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:54:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:54:49.761015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd85b7-4792-45f0-9b8c-b6977ac991d2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.761299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd85b7-4792-45f0-9b8c-b6977ac991d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.761732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd85b7-4792-45f0-9b8c-b6977ac991d2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.763377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 75/159] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:49.764135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd85b7-4792-45f0-9b8c-b6977ac991d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:49.775573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 85/160] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:49 2022] PUT /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/users/89e648082a2448f498c32aa0fccab483/roles/66769d42dee44f55bf70f0358516a8d6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:54:49.780108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:49.780400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:49.780685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:49.823394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:49.825944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:49.966435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 86/161] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:49.993106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:50.001853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd85b7-4792-45f0-9b8c-b6977ac991d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:50.012164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:50.057697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:50.058384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.058670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.058952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.059713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:50.060044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:50.061432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:50.077357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 76/162] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:54:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:50.082762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:50.177454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:50.180447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935afe40-bba7-4d97-854f-ea01d7a0d420 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:50.258420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e619f7-1c48-4412-a057-d1fca4c4a859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:50.259549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e619f7-1c48-4412-a057-d1fca4c4a859 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.260067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e619f7-1c48-4412-a057-d1fca4c4a859 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.260536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e619f7-1c48-4412-a057-d1fca4c4a859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.274887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ebdc-68f3-4f45-ab83-ed1949dd74a5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:50.285656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e619f7-1c48-4412-a057-d1fca4c4a859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-73e619f7-1c48-4412-a057-d1fca4c4a859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:50.296384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:50.297261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:50.298051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:50.304659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 87/163] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:50.306418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0ee5-249d-4c6a-be2c-9779a18b47b9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.308401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0ee5-249d-4c6a-be2c-9779a18b47b9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.309667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0ee5-249d-4c6a-be2c-9779a18b47b9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.312029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 88/164] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:50.314299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b0ee5-249d-4c6a-be2c-9779a18b47b9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:50.356637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff6fa-cf72-4b87-90bf-96e5702443a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:50.357893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff6fa-cf72-4b87-90bf-96e5702443a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.358385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff6fa-cf72-4b87-90bf-96e5702443a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.358871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff6fa-cf72-4b87-90bf-96e5702443a8 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.361708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ff6fa-cf72-4b87-90bf-96e5702443a8 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:50.364406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ff6fa-cf72-4b87-90bf-96e5702443a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:50.366898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 77/165] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:50 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:50.368576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.369084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.375822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.409408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:50.410042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:50.498321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:50.563816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 78/166] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:50.564956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:50.580933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b0ee5-249d-4c6a-be2c-9779a18b47b9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:50.627170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:50.665628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:50.666290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.666580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.666853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.667605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:50.667987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:50.669328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:50.687053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 89/167] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:50.687931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:50.747888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a44741-b27b-4b5f-9fed-241b8b0f47c2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:50.815566 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:50.816168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.816449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.816724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:50.916036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b0782-eb49-44c7-807a-eca2cc38c148 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:50.976257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:50.996860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:50.997686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:50.998049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:50.998326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.011827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:51.011827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:51.031737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:51.042405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:51.043304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:51.044153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:51.048269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 90/168] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:51.050170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:51.082513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:51.202172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 79/169] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:51.203393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:51.237325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b0520-b145-4225-b7ca-47f18594f6ee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:51.282866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:51.284594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:51.285436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:51.286188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] PATH_INFO: `/v3/users/a8aea1f45aa44e67a635de02ad254222` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.292981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a8aea1f45aa44e67a635de02ad254222)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:51.295285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:51.297501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 91/170] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:51 2022] GET /identity/v3/users/a8aea1f45aa44e67a635de02ad254222 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:51.298915 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:51.395011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:51.466898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c56502-de7a-43c2-818b-39fac2c1a8a6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:51.525801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:51.526725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:51.527013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:51.527288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.530015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:51.531487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:51.533559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 92/171] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:51 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:51.534396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:51.617923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc898116-c041-42e7-955c-a655b7cfccec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:51.692659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:51.696132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:51.696431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:51.696707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.697734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:51.698040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:51.699429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:51.710114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 80/172] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:51.710952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:51.721016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:51.781153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed98008-5109-48e6-9464-6ecd616d9701 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:51.831905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:51.851000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff710-5c2d-4a3e-b640-bf3cb757073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:51.851659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff710-5c2d-4a3e-b640-bf3cb757073d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:51.851971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff710-5c2d-4a3e-b640-bf3cb757073d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:51.852249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff710-5c2d-4a3e-b640-bf3cb757073d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.903895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01579c86-b10a-4666-a3a5-46779a40022a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:51.941971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:51.942636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:51.943016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:51.943257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.944240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] RBAC: Adding query filter params (role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=0db87d6d048f40f4a549194f75eacc51) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:51.944555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:51.946550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edbcb5-a0ba-4859-aa4e-5072fc00d6a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:51.953869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 81/173] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:51 2022] GET /identity/v3/role_assignments?user.id=0db87d6d048f40f4a549194f75eacc51&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=d8c3658111d243bf9e85b889e49a811e => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:51.955587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae276d-d8da-4521-b070-fad93a772fba None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:51.956006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae276d-d8da-4521-b070-fad93a772fba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:51.956294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae276d-d8da-4521-b070-fad93a772fba None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:51.957558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 82/174] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:51.958275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae276d-d8da-4521-b070-fad93a772fba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.040794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bff710-5c2d-4a3e-b640-bf3cb757073d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:52.042364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bff710-5c2d-4a3e-b640-bf3cb757073d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:52.095621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:52.173861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae276d-d8da-4521-b070-fad93a772fba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:52.242108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b04f3-79d2-4587-a607-8fd91d62e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:52.243359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b04f3-79d2-4587-a607-8fd91d62e114 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.244136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b04f3-79d2-4587-a607-8fd91d62e114 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.245326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b04f3-79d2-4587-a607-8fd91d62e114 None admin] PATH_INFO: `/v3/users/0db87d6d048f40f4a549194f75eacc51` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.247107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b04f3-79d2-4587-a607-8fd91d62e114 None admin] RBAC: Authorizing `identity:get_user(user_id=0db87d6d048f40f4a549194f75eacc51)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:52.250068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b04f3-79d2-4587-a607-8fd91d62e114 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:52.252361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 83/175] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:51 2022] GET /identity/v3/users/0db87d6d048f40f4a549194f75eacc51 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:52.259821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.259821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.259821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.286422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:52.288389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:52.292549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 93/176] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:52.293476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888acc9-f13b-44c5-b5d6-aff76467457f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.293762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888acc9-f13b-44c5-b5d6-aff76467457f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.294037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888acc9-f13b-44c5-b5d6-aff76467457f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.295842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 94/177] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:52.296775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888acc9-f13b-44c5-b5d6-aff76467457f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.333698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:52.397752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 84/178] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:52.398709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.464515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888acc9-f13b-44c5-b5d6-aff76467457f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:52.471338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:52.508897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:52.509896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.510500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.511074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.517674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df978747-ad8a-49ce-bf2a-b66f9d9664b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:52.556359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd85e3-ae2d-4882-8356-5ff07a4ed714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:52.557229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd85e3-ae2d-4882-8356-5ff07a4ed714 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.557596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd85e3-ae2d-4882-8356-5ff07a4ed714 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.557866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd85e3-ae2d-4882-8356-5ff07a4ed714 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.559104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd85e3-ae2d-4882-8356-5ff07a4ed714 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:52.560667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd85e3-ae2d-4882-8356-5ff07a4ed714 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:52.562422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 85/179] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:52 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:52.563887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.564084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.564341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.581839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:52.583067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:52.593385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:52.595317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:52.625946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:52.663830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 86/180] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:52.663830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.720034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 95/181] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:52.721009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.737057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:52.779519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e0c78-60c8-449e-a005-7242d073a309 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:52.820626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b47676-4ce5-41c5-b7a5-bbb423baf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:52.821527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b47676-4ce5-41c5-b7a5-bbb423baf953 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.821700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b47676-4ce5-41c5-b7a5-bbb423baf953 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.821976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b47676-4ce5-41c5-b7a5-bbb423baf953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.828814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b556b51-1e2b-4bb5-98e8-da1ec74428bd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:52.833236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b47676-4ce5-41c5-b7a5-bbb423baf953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-93b47676-4ce5-41c5-b7a5-bbb423baf953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:52.841220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:52.842162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:52.842979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 87/182] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:52.843635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74505503-73c8-4777-b953-e8800245387c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.844514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74505503-73c8-4777-b953-e8800245387c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.844514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74505503-73c8-4777-b953-e8800245387c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.845593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 88/183] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:52.846164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74505503-73c8-4777-b953-e8800245387c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.865026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:52.877893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:52.878625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:52.881790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:52.881790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:52.881790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=a8aea1f45aa44e67a635de02ad254222) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:52.881790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:52.882451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:52.888758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 96/184] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:52 2022] GET /identity/v3/role_assignments?user.id=a8aea1f45aa44e67a635de02ad254222&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:52.889563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:52.978276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74505503-73c8-4777-b953-e8800245387c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.004518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.011198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba69c27-d2bd-4e43-b256-8b0044acea7f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.017396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.018231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.018516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.018795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.031984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:53.041120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:53.042169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:53.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 89/185] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:54:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:53.043709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.061432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ed79-840f-421d-a927-4ae023e0f42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.062435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ed79-840f-421d-a927-4ae023e0f42f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.062722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ed79-840f-421d-a927-4ae023e0f42f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.063260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ed79-840f-421d-a927-4ae023e0f42f None admin] PATH_INFO: `/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.064362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ed79-840f-421d-a927-4ae023e0f42f None admin] RBAC: Authorizing `identity:get_project(project_id=2484c3cbfcf14cacb47f8b410e9ce62b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.065963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ed79-840f-421d-a927-4ae023e0f42f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.068074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 97/186] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:52 2022] GET /identity/v3/projects/2484c3cbfcf14cacb47f8b410e9ce62b => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.073097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc363-1327-4adb-a056-10e12039958f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.073392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc363-1327-4adb-a056-10e12039958f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.073677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dc363-1327-4adb-a056-10e12039958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.092312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-952dc363-1327-4adb-a056-10e12039958f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:53.093513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-952dc363-1327-4adb-a056-10e12039958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:53.157145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.163365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab59506-3e68-43ec-8e4f-da8dcf0cb2af None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.170781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 98/187] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:53.172117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475cdf3-ea30-4f83-a5bc-15b2a11f0fab None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.172400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475cdf3-ea30-4f83-a5bc-15b2a11f0fab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.172704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475cdf3-ea30-4f83-a5bc-15b2a11f0fab None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.173947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 99/188] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:53.178697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475cdf3-ea30-4f83-a5bc-15b2a11f0fab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.200272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.200945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.201226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.201505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.202252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:53.202553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.203959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.212481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 90/189] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.212481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.258577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.280600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475cdf3-ea30-4f83-a5bc-15b2a11f0fab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.312319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276050-f8ec-4f53-9c78-13191c843845 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.314157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.314823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.315111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.315388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.316173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:53.316484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.317873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502d48-303b-4009-9832-f4e1e72961c2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.326366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 100/190] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.327549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.327869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.328183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.346001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:53.346242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.346903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.347178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:53.347280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.347457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.348318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=2484c3cbfcf14cacb47f8b410e9ce62b, user.id=0db87d6d048f40f4a549194f75eacc51) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:53.348638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.350618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.356544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 91/191] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/role_assignments?user.id=0db87d6d048f40f4a549194f75eacc51&scope.project.id=2484c3cbfcf14cacb47f8b410e9ce62b&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.357326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.415164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.440497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 101/192] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:53.441685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.490525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbcd10-aaa2-49db-b4a9-f117e958e7fe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.500919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.527195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.528135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.528849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.529139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.531026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.532595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.536523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 92/193] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.536523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.570555 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cddfc7-eef9-47e0-94aa-fc7435c212ee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.613142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.614069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.614347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.614664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] PATH_INFO: `/v3/users/921aefcb0ee84d6c8c3950d8c06535f1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.629250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=921aefcb0ee84d6c8c3950d8c06535f1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.630734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.632793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 102/194] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/users/921aefcb0ee84d6c8c3950d8c06535f1 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.633587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.653440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029a64-7ca3-4ff6-8d1e-0b4437c1de06 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.671331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.686882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.687822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.688122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.688398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] PATH_INFO: `/v3/users/921aefcb0ee84d6c8c3950d8c06535f1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.689597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] RBAC: Authorizing `identity:get_user(user_id=921aefcb0ee84d6c8c3950d8c06535f1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.691047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.692702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 93/195] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/users/921aefcb0ee84d6c8c3950d8c06535f1 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:53.693632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.729978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92d098-8219-44aa-b92c-b8e5be93a8b9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.741704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.764170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.764956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.765236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.765503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.775829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:53.783601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:53.784701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:53.785542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 103/196] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:53.786189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:53.798372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6911b-e9f3-40bd-9c20-74cb50bb340f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.832386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.832981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.833263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.833687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.834819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:53.836253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:53.882218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:53.885647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c567b-0038-413b-8f04-d16cbae76f46 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:53.918095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:53.918741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:53.919027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:53.919337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:53.922806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 94/197] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:54:53 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:54:53.922806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.009858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.011371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.041180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.045273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71350b9-190c-49c6-8463-8be012e4a0a6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.087005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.087583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.087892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.088175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.122950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.131964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 104/198] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:54.131964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.174556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.176203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.251335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df3147-dc5e-4148-b63c-801d62bd7aa8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.300333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.301251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.301939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.302223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.303489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:54.304133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.304870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.305965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.309756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 95/199] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:54.310211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.315911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 105/200] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:54.316752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.388263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.441183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6788f4-ea67-4a75-9b23-749ccc64a7ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.444950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2d390-0922-4ee0-a498-69877a8b6866 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.475010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.476075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.476358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.476631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.477866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.479312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.486062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 96/201] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:54.486842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.487273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.488176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.488465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.488743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.490213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.492748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.494496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 106/202] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:54.495268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.566403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.612991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85067-0950-4761-aeda-9136018c709f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.613318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b19211-7cc5-40e4-877a-47dbd76c9ae5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.644489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.652778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.653443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.653726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.654039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.654875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=921aefcb0ee84d6c8c3950d8c06535f1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:54.655231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.656476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.656729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.657372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.657659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.657942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] PATH_INFO: `/v3/users/89e648082a2448f498c32aa0fccab483` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.659347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] RBAC: Authorizing `identity:get_user(user_id=89e648082a2448f498c32aa0fccab483)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.661807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:54.663716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 107/203] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/role_assignments?user.id=921aefcb0ee84d6c8c3950d8c06535f1&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:54.664369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 97/204] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/users/89e648082a2448f498c32aa0fccab483 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:54.668816 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.670152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:54.858864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ffdc0-b521-4211-8af1-c9bd970da139 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.901063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f45db-aba7-4be4-8d3d-20b3422fa1ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:54.913682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:54.914360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:54.914651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:54.914936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:54.918921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:54.996269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:54.997847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:55.001913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:55.002577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:55.002860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:55.003132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:55.004032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] RBAC: Adding query filter params (role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=921aefcb0ee84d6c8c3950d8c06535f1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:55.004342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:55.005779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:55.025902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 108/205] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/role_assignments?user.id=921aefcb0ee84d6c8c3950d8c06535f1&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=d8c3658111d243bf9e85b889e49a811e => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:55.110489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 98/206] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:54:55.116556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:55.209054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:55.271201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcca3-bbfc-484c-8937-0aa2884d7870 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:55.320531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b11237-0945-471b-9c0e-496e1dab38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:55.322205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b11237-0945-471b-9c0e-496e1dab38dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:55.322966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b11237-0945-471b-9c0e-496e1dab38dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:55.323439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b11237-0945-471b-9c0e-496e1dab38dc None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:55.324881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b11237-0945-471b-9c0e-496e1dab38dc None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:55.326543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b11237-0945-471b-9c0e-496e1dab38dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:55.328786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 109/207] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:55 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:55.334908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:55.373930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:55.452899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b93ae-ed42-4848-b10d-fb6ce69e77cd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:55.499342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:55.499960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:55.500358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:55.500640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:55.501476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] RBAC: Adding query filter params (role.id=66769d42dee44f55bf70f0358516a8d6, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f, user.id=89e648082a2448f498c32aa0fccab483) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:55.501787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:55.503243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd6393-11cb-40e0-931c-2eb86392770d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:55.515933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 99/208] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:55 2022] GET /identity/v3/role_assignments?user.id=89e648082a2448f498c32aa0fccab483&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=66769d42dee44f55bf70f0358516a8d6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:56.507854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179b24-eb1b-45b3-9362-92bb26a64d11 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.508822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179b24-eb1b-45b3-9362-92bb26a64d11 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:56.509306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179b24-eb1b-45b3-9362-92bb26a64d11 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:56.511154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 110/209] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:56.516820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.517679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:56.518167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:56.536279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:56.538320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:56.542357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564411-b924-4456-8ba0-0fcc21f6d2af None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.542863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564411-b924-4456-8ba0-0fcc21f6d2af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:56.543360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564411-b924-4456-8ba0-0fcc21f6d2af None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:56.544985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 111/210] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:56.550198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.550734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:56.551218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:56.569762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:56.572711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:56.627865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 100/211] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:56.646000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 112/212] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:56.651805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:56.672206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:56.684230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:56.749736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:56.761610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa350a7-7c0c-43bd-8057-4adc1fcb8d91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:56.798636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:56.799919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.800399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:56.800867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:56.810567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc37c19-f612-4546-a7d4-f74c0a0e0eaf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:56.814226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:56.824158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:56.825162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:54:56.825963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:56.830486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 101/213] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:56.831540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:56.854761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:56.855975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.856456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:56.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:56.858298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:56.859970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:56.861795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 113/214] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:54:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:56.868188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:56.947681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:56.958629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921d59c-c135-4a07-8e09-9029f343176b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:56.997983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:56.998527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324c162-6e50-48ea-840b-00f0205edd25 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:56.999108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:56.999542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.000063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.000967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:57.001422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.003047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.012444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 102/215] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:54:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:57.020081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.030658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:57.045421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7b59f-0e56-4268-b437-523dc072c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.046449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b59f-0e56-4268-b437-523dc072c93a None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.046940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b59f-0e56-4268-b437-523dc072c93a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.047420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7b59f-0e56-4268-b437-523dc072c93a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.048857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7b59f-0e56-4268-b437-523dc072c93a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.051015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7b59f-0e56-4268-b437-523dc072c93a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.133780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1b177-cbf9-49b4-9121-2d58a7b4be40 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:57.168980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.170101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.170205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 114/216] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:54:56 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:54:57.170282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.170434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] PATH_INFO: `/v3/users/91cfd207e3d94b61b84ba8edba756cfa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.181600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cebe1-9dc6-42be-ada8-8be01a79a5a2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.181967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cebe1-9dc6-42be-ada8-8be01a79a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.182259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cebe1-9dc6-42be-ada8-8be01a79a5a2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.187827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 115/217] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:57.189364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.189492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] RBAC: Authorizing `identity:get_user(user_id=91cfd207e3d94b61b84ba8edba756cfa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.189655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.189934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.191066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.193031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 103/218] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/users/91cfd207e3d94b61b84ba8edba756cfa => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:57.199527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.214017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:57.226069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:57.228482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:57.324782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7b28-3eac-43b0-b099-aeceb044265e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:57.344593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 116/219] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:54:57.372747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.375123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.375779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.376087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.376368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.466120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.467598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.480504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:57.517745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf486bf-c24b-45f8-9b47-123c6e601d82 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:57.529523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:57.565437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d8156-dc5b-4721-b10b-1509287a5f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.566242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d8156-dc5b-4721-b10b-1509287a5f59 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.566592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d8156-dc5b-4721-b10b-1509287a5f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.566933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d8156-dc5b-4721-b10b-1509287a5f59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.581883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d8156-dc5b-4721-b10b-1509287a5f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-992d8156-dc5b-4721-b10b-1509287a5f59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:57.595313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:57.596455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:54:57.597299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:54:57.600543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 117/220] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:54:57.605984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 104/221] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:54:57.606809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7244-993e-4ad1-882d-20f35adf9829 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.607171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7244-993e-4ad1-882d-20f35adf9829 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.607523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7244-993e-4ad1-882d-20f35adf9829 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.611225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 118/222] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:54:57.611365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.613722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f7244-993e-4ad1-882d-20f35adf9829 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.731501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f7244-993e-4ad1-882d-20f35adf9829 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:57.736042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b937f-8946-4cac-b67e-f13dc2c06059 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:57.747700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:57.768848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211dfb2-1ecb-4f66-9bdf-ce417955a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.769717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211dfb2-1ecb-4f66-9bdf-ce417955a150 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.770002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211dfb2-1ecb-4f66-9bdf-ce417955a150 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.770280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211dfb2-1ecb-4f66-9bdf-ce417955a150 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.772010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211dfb2-1ecb-4f66-9bdf-ce417955a150 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.773647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211dfb2-1ecb-4f66-9bdf-ce417955a150 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.773757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.774433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.774796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.775131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.775422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 119/223] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:57.776225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:57.776600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.776861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.777145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.777423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.777976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.796934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 105/224] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:57.797814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.807482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:57.808722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:54:57.841363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:57.894536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 120/225] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:54:57.900657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:57.939602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a46c9-b2fa-430d-bae2-73c77174b3dd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:57.984301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:57.984965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:57.985251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:57.985679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:57.986523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=91cfd207e3d94b61b84ba8edba756cfa) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:57.987329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:57.989071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:57.996827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 106/226] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/role_assignments?user.id=91cfd207e3d94b61b84ba8edba756cfa&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:57.998112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.023596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534ab5-93d3-461f-ad65-854a08198795 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.051783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:58.079581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.080543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.080820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.081090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] PATH_INFO: `/v3/users/921aefcb0ee84d6c8c3950d8c06535f1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.082456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] RBAC: Authorizing `identity:get_user(user_id=921aefcb0ee84d6c8c3950d8c06535f1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:58.084111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:58.085907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 121/227] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/users/921aefcb0ee84d6c8c3950d8c06535f1 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:58.102765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.128202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9531-ea87-426f-9b47-0f0e57e95614 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.170491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.171327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.171610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.171910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.185766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:54:58.195558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:54:58.201069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:54:58.201860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 107/228] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:54:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:54:58.204090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.218537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:58.331857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:58.340414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a51404-31ce-43bc-a03d-84f64b12d0ce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.346182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55caa26-1bf4-4d54-b3fb-091acc0161e2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.378131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.378765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.379052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.379331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.380115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:54:58.380426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:58.382554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:58.396161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 108/229] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:54:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:58.398864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.469937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.470803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.471081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.471357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.473553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:58.475624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:58.485193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 122/230] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:58 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:58.498989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.559249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ffe9d-a262-471f-955d-d042edc2d586 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.598710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.600172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.600473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.600753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] PATH_INFO: `/v3/users/921aefcb0ee84d6c8c3950d8c06535f1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.602197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] RBAC: Authorizing `identity:get_user(user_id=921aefcb0ee84d6c8c3950d8c06535f1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:58.603673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:58.606044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 109/231] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:54:58 2022] GET /identity/v3/users/921aefcb0ee84d6c8c3950d8c06535f1 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:54:58.612034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.660278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:58.737861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0a06-9833-4bf9-a3d7-cd5943079663 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.740761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:58.757991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89915e-fc1b-46c1-9e4e-246a58b2abb6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:58.805270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557eb2c-b1d9-4e42-a961-7ff064e6c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.806181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557eb2c-b1d9-4e42-a961-7ff064e6c347 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.806469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557eb2c-b1d9-4e42-a961-7ff064e6c347 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.806745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557eb2c-b1d9-4e42-a961-7ff064e6c347 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/921aefcb0ee84d6c8c3950d8c06535f1/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.813456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557eb2c-b1d9-4e42-a961-7ff064e6c347 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6da103650dc4f5396b0baa0a0050e9a, user_id=921aefcb0ee84d6c8c3950d8c06535f1, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:58.814927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557eb2c-b1d9-4e42-a961-7ff064e6c347 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:58.818746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:58.819616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:58.819926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:58.820407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:58.822639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:58.824149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:58.831047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 110/232] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:54:58 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:54:58.832211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:54:58.905831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 123/233] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:58 2022] PUT /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/921aefcb0ee84d6c8c3950d8c06535f1/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:54:58.948299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:54:58.955479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e053e30-3959-4fca-831e-79e9a14cc9fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:54:59.004238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae6ebc-ac19-4260-95ef-2ef17ccaa6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:54:59.005131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6ebc-ac19-4260-95ef-2ef17ccaa6ea None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:59.005411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6ebc-ac19-4260-95ef-2ef17ccaa6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:59.005689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae6ebc-ac19-4260-95ef-2ef17ccaa6ea None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/921aefcb0ee84d6c8c3950d8c06535f1/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:59.009983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae6ebc-ac19-4260-95ef-2ef17ccaa6ea None admin] RBAC: Authorizing `identity:create_grant(project_id=f6da103650dc4f5396b0baa0a0050e9a, user_id=921aefcb0ee84d6c8c3950d8c06535f1, role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:54:59.011433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae6ebc-ac19-4260-95ef-2ef17ccaa6ea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:54:59.091075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 111/234] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:54:58 2022] PUT /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/921aefcb0ee84d6c8c3950d8c06535f1/roles/d8c3658111d243bf9e85b889e49a811e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:54:59.883321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab53b9b-6975-4689-b697-f58cc27a2f2e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:59.883866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab53b9b-6975-4689-b697-f58cc27a2f2e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:59.883942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab53b9b-6975-4689-b697-f58cc27a2f2e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:59.885291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 124/235] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:54:59.890680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600b04c-30a7-4cfd-942f-cf5d8c09c444 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:54:59.891104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600b04c-30a7-4cfd-942f-cf5d8c09c444 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:54:59.891288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600b04c-30a7-4cfd-942f-cf5d8c09c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:54:59.912957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5600b04c-30a7-4cfd-942f-cf5d8c09c444 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:54:59.914170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5600b04c-30a7-4cfd-942f-cf5d8c09c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:00.006808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 112/236] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:00.031969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab53b9b-6975-4689-b697-f58cc27a2f2e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.063269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cc7d1-8bd9-4d29-aa26-beb779154ca7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.063572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cc7d1-8bd9-4d29-aa26-beb779154ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.063861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cc7d1-8bd9-4d29-aa26-beb779154ca7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.065557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 113/237] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:00.071097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.071389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.071678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.089752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:00.090945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:00.170009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 114/238] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:00.189162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.208523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:00.232481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab53b9b-6975-4689-b697-f58cc27a2f2e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:00.297218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2b6e-22c8-416e-a6c7-e294d9ecfeee None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:00.305881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:00.306946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.307403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.307862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.312494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:00.314169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:00.316308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 125/239] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:00.322211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.336591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:00.337544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.337908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.338260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.352320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:00.360826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:00.361789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:00.362572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:00.367591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 115/240] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:00.369043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.413909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:00.464166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:00.477054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3558e1-8bb9-47cf-8c24-bbd63bb71822 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:00.513943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:00.514781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.515144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.515500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.516382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:00.516746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:00.518223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:00.532165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 116/241] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:00.533677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.590207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19062c14-6f56-424f-9d06-abc2dc7105a7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:00.628789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f330282-55ea-442b-bab0-02c8c53224d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:00.629470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330282-55ea-442b-bab0-02c8c53224d0 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.629754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330282-55ea-442b-bab0-02c8c53224d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.630031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330282-55ea-442b-bab0-02c8c53224d0 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.630823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f330282-55ea-442b-bab0-02c8c53224d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:00.632442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f330282-55ea-442b-bab0-02c8c53224d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:00.658335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a651-8aff-4f1d-873e-57468643bc68 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:00.696890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0902-ce75-4532-9b79-1a2f566a8eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:00.698051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0902-ce75-4532-9b79-1a2f566a8eee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.698341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0902-ce75-4532-9b79-1a2f566a8eee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.698621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0902-ce75-4532-9b79-1a2f566a8eee None admin] PATH_INFO: `/v3/users/d5c8c89c802b495485adc02a6b8eaa98` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.702924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:00.712679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 126/242] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:00 2022] POST /identity/v3/users => generated 293 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:55:00.715002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db61b-cb86-456c-8a4b-af395ca47884 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.715120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0902-ce75-4532-9b79-1a2f566a8eee None admin] RBAC: Authorizing `identity:get_user(user_id=d5c8c89c802b495485adc02a6b8eaa98)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:00.715661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db61b-cb86-456c-8a4b-af395ca47884 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.716192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db61b-cb86-456c-8a4b-af395ca47884 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.716464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0902-ce75-4532-9b79-1a2f566a8eee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:00.722839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 117/244] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:00 2022] GET /identity/v3/users/d5c8c89c802b495485adc02a6b8eaa98 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:00.723142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 127/244] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:00.725087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:00.726640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:00.726640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:00.728513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103db61b-cb86-456c-8a4b-af395ca47884 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.744862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:00.746227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:00.825633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 118/245] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:00.867909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:00.923718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:00.950579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103db61b-cb86-456c-8a4b-af395ca47884 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.010330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.010914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.011199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.011478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.040901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720e869-ddd8-4ca1-8561-352ba873847e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.073368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:01.092146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.093761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.094052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.094332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.103201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.104866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:01.109831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:01.118969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:01.120206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:01.121044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:01.123275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 119/246] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:01.141378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:01.212497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:01.235691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 128/247] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:01.237386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:01.276100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fb6ba-ada0-4714-9961-e47d6ec1db34 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.314904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.315588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.316975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.317096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.317857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:01.318251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.320025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:01.329400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 120/248] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:01.336816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:01.361155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28058d6-c3d4-42d2-8a52-a716d2d60aa0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.400571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:01.418981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.420207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.420675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.421130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.423205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.424996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:01.429066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 129/249] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:01 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:01.435067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:01.473039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa35f7e-f531-4fcc-b187-aa37d2491460 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.505140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:01.517586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.519889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.519889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.519889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] PATH_INFO: `/v3/users/91cfd207e3d94b61b84ba8edba756cfa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.522318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] RBAC: Authorizing `identity:get_user(user_id=91cfd207e3d94b61b84ba8edba756cfa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.524027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:01.527125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 121/250] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:01 2022] GET /identity/v3/users/91cfd207e3d94b61b84ba8edba756cfa => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:01.536338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:01.575726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aabf4-aabd-4e3f-a19b-7c3f1af89bb6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.616382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.617036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.617324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.622768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.622768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] RBAC: Adding query filter params (role.id=66769d42dee44f55bf70f0358516a8d6, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=d5c8c89c802b495485adc02a6b8eaa98) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:01.622768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.622768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:01.628301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 130/251] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:01 2022] GET /identity/v3/role_assignments?user.id=d5c8c89c802b495485adc02a6b8eaa98&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=66769d42dee44f55bf70f0358516a8d6 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:01.724436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb18e1-b7eb-44f6-8ba4-9ff1aff82133 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.748643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:01.774930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b396-5375-498d-a021-249e1524870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.776177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b396-5375-498d-a021-249e1524870f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.776646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b396-5375-498d-a021-249e1524870f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.777177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b396-5375-498d-a021-249e1524870f None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.785167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b396-5375-498d-a021-249e1524870f None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.787375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b396-5375-498d-a021-249e1524870f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:01.790058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 122/252] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:01 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:01.795917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:01.946062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c93c7-d6e0-4ca0-bd5f-6cd1e8aab099 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:01.965335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:01.982532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18006b-7a22-4ce4-8ae2-b54cb582e8e3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.982806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18006b-7a22-4ce4-8ae2-b54cb582e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.983970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18006b-7a22-4ce4-8ae2-b54cb582e8e3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.984701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 123/253] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:01.986088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4fd80-a2db-4b13-8996-2d29177e7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:01.986983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fd80-a2db-4b13-8996-2d29177e7564 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.987263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fd80-a2db-4b13-8996-2d29177e7564 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.987534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fd80-a2db-4b13-8996-2d29177e7564 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/91cfd207e3d94b61b84ba8edba756cfa/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.989590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4fd80-a2db-4b13-8996-2d29177e7564 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6da103650dc4f5396b0baa0a0050e9a, user_id=91cfd207e3d94b61b84ba8edba756cfa, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:01.990040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:01.990683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:01.991165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:01.991284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4fd80-a2db-4b13-8996-2d29177e7564 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:02.017290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:02.018518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:02.078789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 131/254] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:01 2022] PUT /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/91cfd207e3d94b61b84ba8edba756cfa/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:02.080475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dfa3d-98ad-4e02-9273-d5b4d17f056d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.080822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dfa3d-98ad-4e02-9273-d5b4d17f056d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.081105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dfa3d-98ad-4e02-9273-d5b4d17f056d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.086259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 132/255] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:02.092008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.092398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.092684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.101380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 124/256] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:02.119733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:02.121073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:02.125195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.233308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc3daf-1dc9-41fb-8f33-127b55837170 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:02.246992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:02.265733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 133/257] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:02.269442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:02.270235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.270515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.270787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.282364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:02.290764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:02.291699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:02.293500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 125/258] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:02.298224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.318687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.452493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bba54-84c8-4c72-a61b-8231d9d0b76f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:02.468213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:02.476560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9432619-2562-4d35-8b62-c23deb67e434 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:02.494845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:02.495698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.496011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.496286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.497144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:02.497458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:02.498869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:02.509676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 134/259] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:02.518124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.520755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:02.521858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.522313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.522720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.549729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:02.560596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:02.567870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:02.569746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 126/260] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:02.571957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.628165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:02.737930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccc4ef-8ed4-4b48-9393-8c7d967fcf46 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:02.743027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531d8c6-53a9-40d1-8c63-b2e3d26a1e8e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:02.797252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:02.798385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.798818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.799266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] PATH_INFO: `/v3/users/921aefcb0ee84d6c8c3950d8c06535f1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.800650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] RBAC: Authorizing `identity:get_user(user_id=921aefcb0ee84d6c8c3950d8c06535f1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:02.802576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:02.803815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:02.804497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:02.804916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:02.805201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:02.809712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:02.809712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:02.809712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:02.810165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 135/261] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/users/921aefcb0ee84d6c8c3950d8c06535f1 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:02.811160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.821239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 127/262] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:02.831819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:02.877689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:02.967348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ba24c-4c34-40d8-83b3-411aa3779a6e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.019457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.020366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.020822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.021300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.058734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:03.069910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bcd9a-ea1b-4264-b792-732d1509851d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.132578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.133848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.133848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.134124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] PATH_INFO: `/v3/users/921aefcb0ee84d6c8c3950d8c06535f1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.136608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] RBAC: Authorizing `identity:get_user(user_id=921aefcb0ee84d6c8c3950d8c06535f1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.138079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.139738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 128/263] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/users/921aefcb0ee84d6c8c3950d8c06535f1 => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:03.145244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:03.189992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.191520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.260308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb155b-7d4f-498e-babe-337e05b8900f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.264487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:03.313098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.313770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.314057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.314333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.361135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 136/264] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:03.368842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:03.369352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:03.419160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.420783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.530493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 129/265] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:55:03.531503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b21ab-e50e-4a58-b776-de519b620115 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.535769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:03.596626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.597420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.597708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.597986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.599252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.600831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.602717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 137/266] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:03 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:03.608665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:03.612237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:03.626887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:03.644225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27f424-36a8-44e2-91ff-93a1d1e04ddd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.680649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.681620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.681909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.682184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.683383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.685103 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.686985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 130/267] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:03 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:03.692585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:03.741231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf761a7-192f-4b70-ada5-d6194c62cd2f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.780334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.780998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.781282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.781560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.782427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=921aefcb0ee84d6c8c3950d8c06535f1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:03.782740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.784246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b364a-480e-42bb-9ad6-d75edb9b99e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.792861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 138/268] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:03 2022] GET /identity/v3/role_assignments?user.id=921aefcb0ee84d6c8c3950d8c06535f1&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:03.840207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc9e7d-b3ff-4e89-a4a9-46d4bda5341a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:03.886464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:03.893372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:03.897558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:03.897558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:03.897558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:03.897558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] RBAC: Adding query filter params (role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=921aefcb0ee84d6c8c3950d8c06535f1) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:03.897558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:03.900244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7783a8-2d68-40b2-96b6-46f72837b47f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:03.907017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 131/269] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:03 2022] GET /identity/v3/role_assignments?user.id=921aefcb0ee84d6c8c3950d8c06535f1&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=d8c3658111d243bf9e85b889e49a811e => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:04.309660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd7c06-ab5d-4a8e-93a9-392decd1b2a0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.310265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd7c06-ab5d-4a8e-93a9-392decd1b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.310265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd7c06-ab5d-4a8e-93a9-392decd1b2a0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.311851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 139/270] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:04.317022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.317507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.317657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.341199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:04.342719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:04.429153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 132/271] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:04.463935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd7c06-ab5d-4a8e-93a9-392decd1b2a0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:04.557322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:04.594596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd7c06-ab5d-4a8e-93a9-392decd1b2a0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:04.635850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24119d-d791-42dc-8328-9eae1756a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:04.636916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24119d-d791-42dc-8328-9eae1756a745 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.637341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24119d-d791-42dc-8328-9eae1756a745 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.637798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24119d-d791-42dc-8328-9eae1756a745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.639271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24119d-d791-42dc-8328-9eae1756a745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:04.640976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24119d-d791-42dc-8328-9eae1756a745 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:04.643247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 140/272] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:04.649825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:04.767075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6ad7f-3bf5-4004-8047-db6abd46cd91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:04.793630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:04.805495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c8699-c1a6-44d7-983d-86ca6923f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:04.806257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c8699-c1a6-44d7-983d-86ca6923f461 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.806589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c8699-c1a6-44d7-983d-86ca6923f461 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.806871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c8699-c1a6-44d7-983d-86ca6923f461 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.807605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c8699-c1a6-44d7-983d-86ca6923f461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:04.809160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c8699-c1a6-44d7-983d-86ca6923f461 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:04.840917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e6e5-565a-4c40-9d4c-fa3a6ad0b263 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.841254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e6e5-565a-4c40-9d4c-fa3a6ad0b263 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.841529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e6e5-565a-4c40-9d4c-fa3a6ad0b263 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.842919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 141/273] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:04.848450 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.848737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.849088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.867087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:04.868400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:04.913725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 133/274] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:04 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:04.926152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1b226-a879-4420-b055-99d941a0527c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.926797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1b226-a879-4420-b055-99d941a0527c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.927277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1b226-a879-4420-b055-99d941a0527c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.929281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 134/275] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:04.935295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:04.935968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:04.936453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:04.956182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:04.957802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:04.959850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 142/276] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:04.981791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.038785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 135/277] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:05.061377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:05.062599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.103541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b48984-eb65-4132-b46f-e937a5093991 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.151161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.152345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.153257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.153718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.168718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:05.179997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:05.180905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:05.181700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:05.183833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 143/278] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:05.186082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add43e-3df8-4c1b-97af-88686da207b0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.188445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.201485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:05.246375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.246375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.246375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.246375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.259562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:05.267999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:05.268918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:05.270221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 136/279] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:05.276510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.341572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13fbfb-7217-4f76-aad2-465c0c2df14a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.371686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:05.380172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.381027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.386847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.386847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.386847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:05.386847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:05.386847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b4662-e648-4965-b4a6-9eabfbd80828 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:05.395656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 144/280] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:05.398446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9352f-ccf9-4cbb-9ea7-c28772240ff5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.399069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9352f-ccf9-4cbb-9ea7-c28772240ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.399492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9352f-ccf9-4cbb-9ea7-c28772240ff5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.401748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 145/281] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:05.402602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9352f-ccf9-4cbb-9ea7-c28772240ff5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.402838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812c7b6-2044-45d3-a91a-ad21df45f6a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.451925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.452650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.453008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.453363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.454192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:05.454617 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:05.456184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac445827-3435-400e-bfe1-b46844170583 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:05.465888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 137/282] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:05.471938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.472349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.472701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.492284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:05.493720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:05.523067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:05.547096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9352f-ccf9-4cbb-9ea7-c28772240ff5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.574354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 138/283] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:05.579838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.605938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.606812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.607095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.607368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] PATH_INFO: `/v3/users/fbc33899de1a43319f20b2d3a079d83a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.622876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] RBAC: Authorizing `identity:get_user(user_id=fbc33899de1a43319f20b2d3a079d83a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:05.624415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:05.626108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 146/284] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/users/fbc33899de1a43319f20b2d3a079d83a => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:05.626879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.696277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:05.715937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb13e02-8503-4ac2-870b-62f0e072d05f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.753643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa33a94-ed62-48a8-bc58-387db030cc6c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.761322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.762953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.763463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.763960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] PATH_INFO: `/v3/users/d5c8c89c802b495485adc02a6b8eaa98` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.766227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c8c89c802b495485adc02a6b8eaa98)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:05.768216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:05.771009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 139/285] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/users/d5c8c89c802b495485adc02a6b8eaa98 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:05.772469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.795091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.796074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.796600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.796955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.811877 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:05.812639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:05.823862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:05.828794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 147/286] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:05.829582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.910038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c5b2e-934d-48ae-a173-3e6d4ed6fdb3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.951083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:05.952117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:05.952406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:05.952732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:05.953581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, user.id=fbc33899de1a43319f20b2d3a079d83a, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:05.953890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:05.955339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:05.961758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 140/287] 10.222.0.44 () {56 vars in 1308 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/role_assignments?user.id=fbc33899de1a43319f20b2d3a079d83a&scope.system=all&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:05.962598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:05.981757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4d335-fbb7-4f00-a07d-e2a57b16c9b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:05.997256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:06.053614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:06.054499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:06.054782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:06.055054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:06.058985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:06.062861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:06.068149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 148/288] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:06.074215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:06.126036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62f7c3-5fcb-4c6b-961d-ace7289e12be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:06.144217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:06.169480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:06.170088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:06.170373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:06.170657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:06.172556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:06.172556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:06.173134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:06.184380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 141/289] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:06.190013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:06.266154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd8d3-e1dc-4c52-ad0d-bc0ba2c49189 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:06.299283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd712e-0880-4f5a-936f-6f267cbd7046 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:06.305982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:06.307206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:06.307918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:06.308400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/d5c8c89c802b495485adc02a6b8eaa98/roles/66769d42dee44f55bf70f0358516a8d6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:06.310913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6da103650dc4f5396b0baa0a0050e9a, user_id=d5c8c89c802b495485adc02a6b8eaa98, role_id=66769d42dee44f55bf70f0358516a8d6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:06.312732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:06.341838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:06.342711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:06.342996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:06.343277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] PATH_INFO: `/v3/users/91cfd207e3d94b61b84ba8edba756cfa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:06.344511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] RBAC: Authorizing `identity:get_user(user_id=91cfd207e3d94b61b84ba8edba756cfa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:06.346041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:06.347841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 142/290] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:06 2022] GET /identity/v3/users/91cfd207e3d94b61b84ba8edba756cfa => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:06.354663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:06.383560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:06.411443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 149/291] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:06 2022] PUT /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/users/d5c8c89c802b495485adc02a6b8eaa98/roles/66769d42dee44f55bf70f0358516a8d6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:55:06.472085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb125ad2-3e36-45ea-ba26-e2453234590f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:06.515575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:06.516268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:06.516556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:06.516832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:06.598060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:06.599624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:06.628021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:06.723066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 143/292] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:06.729047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:06.772317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:06.851885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b7660-34c8-4018-9579-66fe0a0b6a63 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:06.901432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96547d4-bf55-49b6-ae37-4d6959d26c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:06.902307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96547d4-bf55-49b6-ae37-4d6959d26c9d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:06.902591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96547d4-bf55-49b6-ae37-4d6959d26c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:06.902866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96547d4-bf55-49b6-ae37-4d6959d26c9d None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:06.904114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96547d4-bf55-49b6-ae37-4d6959d26c9d None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:06.905568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96547d4-bf55-49b6-ae37-4d6959d26c9d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:06.907581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 150/293] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:06 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:06.913184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:07.089754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8cd2-e375-4974-aa5d-0e45ad97b7e3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:07.119460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:07.133439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:07.134106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.134394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.135908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.135908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=91cfd207e3d94b61b84ba8edba756cfa) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:07.135908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:07.137241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02177f-2f91-45c8-b16d-95668fc1f615 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:07.148693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 144/294] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:06 2022] GET /identity/v3/role_assignments?user.id=91cfd207e3d94b61b84ba8edba756cfa&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:07.607388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4fc2a-9c88-427d-87c9-2c260334a262 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.607924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4fc2a-9c88-427d-87c9-2c260334a262 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.607999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4fc2a-9c88-427d-87c9-2c260334a262 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.609344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 151/295] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:07.615491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.616085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.616085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.633702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:07.634894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:07.650879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f26d0-f2a1-454a-8851-d5cef7935ed6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.651167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f26d0-f2a1-454a-8851-d5cef7935ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.651439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f26d0-f2a1-454a-8851-d5cef7935ed6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.653024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 152/296] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:07.661302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.661617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.662431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.688013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:07.689200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:07.727703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 145/297] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:07.761023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:07.779353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 153/298] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:07.805034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:07.848876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:07.871566 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be726fa8-bfff-4f4c-9d60-d6bf011a7148 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:07.890148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:07.907725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:07.908949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.909437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.909893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.912372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:07.914857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:07.917656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 146/299] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:07.919827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367c6ce-0cc5-4421-a11d-5222c5050319 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:07.924015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:07.958778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:07.959759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:07.960057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:07.960341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:07.971863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:07.980287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:07.981207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:07.982010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:07.986242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 154/300] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:07.987274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:08.070541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecfe61-23ad-4275-8312-25e57342d638 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:08.090027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:08.096477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b13d88-a44a-4650-bae4-2a924a50e1ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:08.111032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:08.112047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.112502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.112955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] PATH_INFO: `/v3/groups` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.113894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:08.116403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:08.131961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:08.132642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.132929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.133234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.133997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:08.134310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:08.135767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:08.145311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 155/301] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:08.151415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:08.175480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 147/302] 10.222.0.44 () {60 vars in 1134 bytes} [Tue May 24 09:55:07 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:08.307613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aa348-6f37-4304-b604-e93f0416d4e2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:08.346969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a71ee-5b4a-4b62-b642-4dc736270ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:08.348258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a71ee-5b4a-4b62-b642-4dc736270ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.348943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a71ee-5b4a-4b62-b642-4dc736270ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.349482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a71ee-5b4a-4b62-b642-4dc736270ad2 None admin] PATH_INFO: `/v3/users/bcbb48d9efbe4f55a03e499fe51202db` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.364189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a71ee-5b4a-4b62-b642-4dc736270ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=bcbb48d9efbe4f55a03e499fe51202db)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:08.366532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a71ee-5b4a-4b62-b642-4dc736270ad2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:08.368480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 156/303] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:08 2022] GET /identity/v3/users/bcbb48d9efbe4f55a03e499fe51202db => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:08.374281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:08.436920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:08.498611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388562ed-c4e0-403f-b889-48c74612d442 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:08.534548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:08.535214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.535504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.535784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.537168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] RBAC: Adding query filter params (role.id=66769d42dee44f55bf70f0358516a8d6, user.id=bcbb48d9efbe4f55a03e499fe51202db, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:08.537484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:08.538932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e055df2-5f5d-44d8-8a44-c049ac00ceea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:08.544789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 148/304] 10.222.0.44 () {56 vars in 1308 bytes} [Tue May 24 09:55:08 2022] GET /identity/v3/role_assignments?user.id=bcbb48d9efbe4f55a03e499fe51202db&scope.system=all&role.id=66769d42dee44f55bf70f0358516a8d6 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:08.600714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67238-8ba0-4fe9-be8c-ea32a1a73fd3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.601059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67238-8ba0-4fe9-be8c-ea32a1a73fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.601275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67238-8ba0-4fe9-be8c-ea32a1a73fd3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.602698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 157/305] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:08.608884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.609195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.609438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.627560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:08.628928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:08.702481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 149/306] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:08.725973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c67238-8ba0-4fe9-be8c-ea32a1a73fd3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:08.744371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:08.832954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c67238-8ba0-4fe9-be8c-ea32a1a73fd3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:08.869393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:08.870104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:08.870386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:08.870656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:08.881732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:08.889794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:08.891870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:08.893902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:08.899823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 158/307] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:08.900021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:08.939585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:09.007433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222bb00-b8f1-4372-bf0d-d38986ca9463 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.042976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.043653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.043973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.044260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.045013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:09.045325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:09.046711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2a778-74ea-491e-ae18-2845712a9d8e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:09.060647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 150/308] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:09.069693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:09.148269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:09.156695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1116ef-6a8b-4da9-9eaa-83f8b1429a0b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.156981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1116ef-6a8b-4da9-9eaa-83f8b1429a0b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.157258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1116ef-6a8b-4da9-9eaa-83f8b1429a0b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.158743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 151/309] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:09.164392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.164903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.168859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.175937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e2240-e74a-4e13-bee5-bb786c2eaebe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.182733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:09.185322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:09.217839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.218887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.219216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.219503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] PATH_INFO: `/v3/users/fbc33899de1a43319f20b2d3a079d83a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.221489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] RBAC: Authorizing `identity:get_user(user_id=fbc33899de1a43319f20b2d3a079d83a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:09.222947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:09.227944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 159/310] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:09 2022] GET /identity/v3/users/fbc33899de1a43319f20b2d3a079d83a => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:09.231397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:09.271826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 152/311] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:09.293462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:09.331063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:09.362669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034b228-9bba-4774-9e83-b6dd2fdf6558 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.409084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.410647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.411342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.411825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] PATH_INFO: `/v3/system/users/fbc33899de1a43319f20b2d3a079d83a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.413502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091030a-d496-4777-b48b-7dc5de2853f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.413645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fbc33899de1a43319f20b2d3a079d83a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:09.415319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:09.452447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.453357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.453650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.453927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.466021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:09.474136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:09.475107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:09.476046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 153/312] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:09.481032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:09.483859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 160/313] 10.222.0.44 () {58 vars in 1334 bytes} [Tue May 24 09:55:09 2022] PUT /identity/v3/system/users/fbc33899de1a43319f20b2d3a079d83a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:09.589336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:09.598512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027775b-140b-4f95-8a05-4ae97872ec50 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.636815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.637483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.637780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.638061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.638825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:09.639140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:09.640596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:09.650816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 154/314] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:09.657194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:09.667501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:09.768586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79ba0c-d33b-4ebd-a435-aaa7bdc7c3c7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.807173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.808105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.808386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.808669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] PATH_INFO: `/v3/users/d5c8c89c802b495485adc02a6b8eaa98` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.809862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c8c89c802b495485adc02a6b8eaa98)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:09.811378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:09.813469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 161/315] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:09 2022] GET /identity/v3/users/d5c8c89c802b495485adc02a6b8eaa98 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:09.819141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:09.930007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48fa532-3cbd-4aa9-b02b-81a8895f7b71 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:09.964361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:09.965019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:09.965305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:09.965586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:09.994487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:10.040645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:10.042772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:10.147293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 155/316] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:55:10.152832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:10.231985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:10.258170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8af29a-0ab1-423c-a84a-430e5c951db9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:10.294022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411995cf-c3c7-41eb-b38f-3920a0593d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:10.294953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411995cf-c3c7-41eb-b38f-3920a0593d18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.295234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411995cf-c3c7-41eb-b38f-3920a0593d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.295507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411995cf-c3c7-41eb-b38f-3920a0593d18 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:10.296766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411995cf-c3c7-41eb-b38f-3920a0593d18 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:10.298262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411995cf-c3c7-41eb-b38f-3920a0593d18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:10.300289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 162/317] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:10 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:10.306847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:10.364164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:10.415259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a1c0-1d67-4898-9ba7-8cfc172693b0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:10.451731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:10.452433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.452719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.453003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:10.453831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] RBAC: Adding query filter params (role.id=66769d42dee44f55bf70f0358516a8d6, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a, user.id=d5c8c89c802b495485adc02a6b8eaa98) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:10.454141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:10.455577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfef529-6625-4bcc-bc68-c84aeca988a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:10.462849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 156/318] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:10 2022] GET /identity/v3/role_assignments?user.id=d5c8c89c802b495485adc02a6b8eaa98&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=66769d42dee44f55bf70f0358516a8d6 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:10.581512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32938-dca8-4bbe-9516-f793cad22236 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.581866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32938-dca8-4bbe-9516-f793cad22236 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.582073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e32938-dca8-4bbe-9516-f793cad22236 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:10.584298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 163/319] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:10.589940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.590236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.590521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:10.609393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:10.610598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:10.685806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 157/320] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:10.708773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e32938-dca8-4bbe-9516-f793cad22236 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:10.825045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e32938-dca8-4bbe-9516-f793cad22236 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:10.861136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5d7d7-c60e-460e-a861-44b5f32519e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:10.862287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5d7d7-c60e-460e-a861-44b5f32519e6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.862870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5d7d7-c60e-460e-a861-44b5f32519e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.863349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5d7d7-c60e-460e-a861-44b5f32519e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:10.865552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5d7d7-c60e-460e-a861-44b5f32519e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:10.867448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5d7d7-c60e-460e-a861-44b5f32519e6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:10.869690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 164/321] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:10.874869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:10.925119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:10.975282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc67fc-5981-4c01-bd45-c12472dff395 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:10.986608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0a7d-8766-4bbc-b2bd-661daa5d5e45 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.986895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0a7d-8766-4bbc-b2bd-661daa5d5e45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.987170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0a7d-8766-4bbc-b2bd-661daa5d5e45 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:10.988693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 165/322] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:10.994017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:10.994307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:10.994584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.012737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:11.012737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.012978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.013182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] PATH_INFO: `/v3/groups` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.013700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:11.013804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:11.015263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:11.015541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:11.028139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:11.126655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 158/323] 10.222.0.44 () {60 vars in 1134 bytes} [Tue May 24 09:55:10 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:11.164327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 166/324] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:11.181713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:11.327173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503f13a-80a3-4518-9adc-1134fd1e44bf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:11.338683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:11.375588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:11.377499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.377499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.377499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.400899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:11.410687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:11.412181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:11.413205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 159/325] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:11.418869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:11.552026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e815-3ab8-465b-a519-ac3054b86676 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:11.603647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:11.604354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.604637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.604917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.605657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:11.605959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:11.607338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:11.616521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 167/326] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:11.622070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:11.736165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00550e56-2f88-4629-b440-db7cb5939eec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:11.772858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fc062-ead9-483d-8e43-2b58dceb3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:11.773658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fc062-ead9-483d-8e43-2b58dceb3e3b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.773938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fc062-ead9-483d-8e43-2b58dceb3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.774212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fc062-ead9-483d-8e43-2b58dceb3e3b None admin] PATH_INFO: `/v3/users/bcbb48d9efbe4f55a03e499fe51202db` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.775408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fc062-ead9-483d-8e43-2b58dceb3e3b None admin] RBAC: Authorizing `identity:get_user(user_id=bcbb48d9efbe4f55a03e499fe51202db)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:11.776905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fc062-ead9-483d-8e43-2b58dceb3e3b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:11.778648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 160/327] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:11 2022] GET /identity/v3/users/bcbb48d9efbe4f55a03e499fe51202db => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:11.784372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:11.788229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:11.854297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e9ca9-34a9-4cc5-bf80-2e29d786af02 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.854621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e9ca9-34a9-4cc5-bf80-2e29d786af02 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.854852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e9ca9-34a9-4cc5-bf80-2e29d786af02 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.856237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 161/328] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:11.868327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.868769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.869159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.888396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:11.890318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:11.903183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189dd45-40a9-436b-9769-089e02da5f40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:11.935083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:11.941301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:11.942399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:11.942890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:11.943316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] PATH_INFO: `/v3/system/users/bcbb48d9efbe4f55a03e499fe51202db/roles/66769d42dee44f55bf70f0358516a8d6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:11.945154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bcbb48d9efbe4f55a03e499fe51202db, role_id=66769d42dee44f55bf70f0358516a8d6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:11.946549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:11.987300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 162/329] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:12.010669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:12.026099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 168/330] 10.222.0.44 () {58 vars in 1334 bytes} [Tue May 24 09:55:11 2022] PUT /identity/v3/system/users/bcbb48d9efbe4f55a03e499fe51202db/roles/66769d42dee44f55bf70f0358516a8d6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:12.139777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01989c9e-7d78-4f9e-9bea-4398b87f29e0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:12.187012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:12.187858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:12.188146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:12.188421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:12.206066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:12.219108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:12.220102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:12.221532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 163/331] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:12.226900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:12.314938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:12.374522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1e8ee-78c1-4fa9-bef7-72ee405edb27 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:12.426233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:12.427221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:12.431820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:12.432333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:12.433256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:12.433799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:12.435339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:12.450002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 169/332] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:12.453829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:12.504355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:12.589667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0def99d-794b-4e23-9eb2-2d0144bd82ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:12.631384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37470d65-3c83-41d9-aa97-1ca65df9974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:12.632317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37470d65-3c83-41d9-aa97-1ca65df9974e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:12.632603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37470d65-3c83-41d9-aa97-1ca65df9974e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:12.632880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37470d65-3c83-41d9-aa97-1ca65df9974e None admin] PATH_INFO: `/v3/users/fbc33899de1a43319f20b2d3a079d83a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:12.634112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37470d65-3c83-41d9-aa97-1ca65df9974e None admin] RBAC: Authorizing `identity:get_user(user_id=fbc33899de1a43319f20b2d3a079d83a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:12.635577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37470d65-3c83-41d9-aa97-1ca65df9974e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:12.637548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 164/333] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:12 2022] GET /identity/v3/users/fbc33899de1a43319f20b2d3a079d83a => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:12.642919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:12.831568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1256e4-702a-412b-9bfa-59e19426be65 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:12.870916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:12.879673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:12.880452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:12.880739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:12.881021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:12.881905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] RBAC: Adding query filter params (role.id=ee2edaaf7e5e4667880cd978b8cc1137, user.id=fbc33899de1a43319f20b2d3a079d83a, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:12.882221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:12.883678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ee462-7be8-4b22-a550-1679adc1258f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:12.898315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 170/334] 10.222.0.44 () {56 vars in 1308 bytes} [Tue May 24 09:55:12 2022] GET /identity/v3/role_assignments?user.id=fbc33899de1a43319f20b2d3a079d83a&scope.system=all&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:14.095728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224341d-b368-46a0-b25d-92f392cfcaad None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:14.096262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224341d-b368-46a0-b25d-92f392cfcaad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:14.096338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224341d-b368-46a0-b25d-92f392cfcaad None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:14.097907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 165/335] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:14.105027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:14.105925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:14.106429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:14.127874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:14.129398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:14.230033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 171/336] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:14.265853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224341d-b368-46a0-b25d-92f392cfcaad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:14.381591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:14.391257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224341d-b368-46a0-b25d-92f392cfcaad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:14.438030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:14.438838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:14.439123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:14.439396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:14.460038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:14.467932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:14.468822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:14.469620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 166/337] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:14.476819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:14.600562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c4660-4aa8-4451-8b37-a2da1878b862 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:14.624630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:14.644392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:14.644986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:14.645273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:14.645551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:14.646618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:14.646949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:14.648421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:14.663911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 172/338] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:14.669442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:14.780617 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162029f-13f6-47b8-9e52-76a06c87d00f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:14.823128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc12de-a56c-4c2c-8499-d37ba45ff16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:14.823784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc12de-a56c-4c2c-8499-d37ba45ff16a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:14.824102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc12de-a56c-4c2c-8499-d37ba45ff16a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:14.824380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc12de-a56c-4c2c-8499-d37ba45ff16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:14.868399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:14.907622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc12de-a56c-4c2c-8499-d37ba45ff16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:14.913186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc12de-a56c-4c2c-8499-d37ba45ff16a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:15.037797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 167/339] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:15.043180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:15.073889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a965-1d59-4b20-a085-29499ec3d0f4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.074217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a965-1d59-4b20-a085-29499ec3d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.074455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a965-1d59-4b20-a085-29499ec3d0f4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.075879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 168/340] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:15.081945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.082229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.082504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.108846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:15.110060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:15.184894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:15.212287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 169/341] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:15.237828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414fe73-ccad-4951-a0f6-1d498f1560dc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:15.258237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:15.303781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:15.304987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.305417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.305837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.307367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:15.309054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:15.311072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 173/342] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:15 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:15.316773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:15.433000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:15.459857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ef7ce-a277-4857-b6ca-8af36f5b4bfa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:15.504605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b3bd4-4119-4541-a767-ded2731f77cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:15.505830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3bd4-4119-4541-a767-ded2731f77cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.506325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3bd4-4119-4541-a767-ded2731f77cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.506791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b3bd4-4119-4541-a767-ded2731f77cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.524812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b3bd4-4119-4541-a767-ded2731f77cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ed0b3bd4-4119-4541-a767-ded2731f77cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:15.533427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:15.534333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:15.535136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:15.542121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 170/343] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:15.543678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce78ce-6671-4e1c-9fea-c7e8b9c0a788 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.544181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce78ce-6671-4e1c-9fea-c7e8b9c0a788 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.544657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce78ce-6671-4e1c-9fea-c7e8b9c0a788 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.546219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 171/344] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:15.549563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce78ce-6671-4e1c-9fea-c7e8b9c0a788 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:15.595201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7389d-95a5-46b7-afc8-f84829ccdcba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:15.619469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:15.686974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce78ce-6671-4e1c-9fea-c7e8b9c0a788 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:15.714035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f223c56-0dad-44ea-9fb1-cd527d9920c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:15.715010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f223c56-0dad-44ea-9fb1-cd527d9920c5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.715518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f223c56-0dad-44ea-9fb1-cd527d9920c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.716019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f223c56-0dad-44ea-9fb1-cd527d9920c5 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.726630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:15.727729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.728218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.728638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.729356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f223c56-0dad-44ea-9fb1-cd527d9920c5 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:15.729713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:15.730186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:15.731176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f223c56-0dad-44ea-9fb1-cd527d9920c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:15.731937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:15.734504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 174/345] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:15 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:15.735927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655392f-dfda-4e7e-928d-f57792ac9cbf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.736318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655392f-dfda-4e7e-928d-f57792ac9cbf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.736715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655392f-dfda-4e7e-928d-f57792ac9cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.742443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 172/346] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:15.743574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:15.773985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7655392f-dfda-4e7e-928d-f57792ac9cbf None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:15.775374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7655392f-dfda-4e7e-928d-f57792ac9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:15.859840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de884465-fe02-46c4-896f-bdda321b186d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:15.892207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:15.900152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:15.901175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.904447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.904447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.904447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:15.904447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:15.905207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:15.912944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 173/347] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:15 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:15.914159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:15.928068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 175/348] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:15.941112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56b080-0958-45d7-99a5-82a11806983c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.941481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56b080-0958-45d7-99a5-82a11806983c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56b080-0958-45d7-99a5-82a11806983c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.943164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 176/349] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:15.950623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:15.950917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:15.951201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:15.980516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:15.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:16.034642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05c92-4dc8-4bc4-8021-46b08be61785 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.048461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.078563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994732f-2032-48cc-b3db-9ba112699733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.080893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994732f-2032-48cc-b3db-9ba112699733 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.081447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994732f-2032-48cc-b3db-9ba112699733 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.082295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994732f-2032-48cc-b3db-9ba112699733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.116340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 177/350] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:16.117439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.138658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.172127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994732f-2032-48cc-b3db-9ba112699733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:16.174079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994732f-2032-48cc-b3db-9ba112699733 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:16.251103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfc3d8-7abc-40fc-8fd5-d3cb7446b642 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.284974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 174/351] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:16.287095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec05324-43b7-40e3-935a-d5d97f79921f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.287418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec05324-43b7-40e3-935a-d5d97f79921f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.287763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec05324-43b7-40e3-935a-d5d97f79921f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.289186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.290007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.290291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.290568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.293455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 175/352] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:16.294247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec05324-43b7-40e3-935a-d5d97f79921f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.309116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:16.319003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:16.319979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 178/353] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:16.321579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.356013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.380646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.404973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec05324-43b7-40e3-935a-d5d97f79921f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.450116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3a39e-c9ca-4cf2-a3df-afd3d4ad80b5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.463200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fb7d4-ef5f-417a-9f71-ee66a850414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.466382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb7d4-ef5f-417a-9f71-ee66a850414a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.466382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb7d4-ef5f-417a-9f71-ee66a850414a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.466382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb7d4-ef5f-417a-9f71-ee66a850414a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.478645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fb7d4-ef5f-417a-9f71-ee66a850414a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec6fb7d4-ef5f-417a-9f71-ee66a850414a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:16.487486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:16.488641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:16.489979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 176/354] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:16.490698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b07ff-4f2c-4c89-81ad-75d01dd32161 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.490698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b07ff-4f2c-4c89-81ad-75d01dd32161 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.491662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b07ff-4f2c-4c89-81ad-75d01dd32161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.503202 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.504436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.504930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.505636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.507058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:16.508097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-202b07ff-4f2c-4c89-81ad-75d01dd32161 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:16.508996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:16.509299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-202b07ff-4f2c-4c89-81ad-75d01dd32161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:16.511127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 179/355] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:16.512144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.596568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 177/356] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:16.598238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb676a2-b20f-42ba-b4fc-4d9cb06c8530 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.598775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb676a2-b20f-42ba-b4fc-4d9cb06c8530 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.599218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb676a2-b20f-42ba-b4fc-4d9cb06c8530 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.600637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 178/357] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:16.601320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb676a2-b20f-42ba-b4fc-4d9cb06c8530 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.638146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80cfb-db46-4565-b6a4-92ca2d1beb18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.652228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.674579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.683031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.685030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.685030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.685030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.687690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:16.687690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:16.688933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:16.701767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 180/358] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:16.702641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.729462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb676a2-b20f-42ba-b4fc-4d9cb06c8530 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.773451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.774497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.774497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.774731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.775740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:16.775740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:16.778365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128f114-5c0c-4ec3-929f-7c029e5f67b2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:16.788003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 179/359] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:16.789018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.789304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.789578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.809203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:16.811440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:16.831552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b892b9-5ed0-4864-9a5d-e986411c38df None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:16.870585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:16.871544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:16.871942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:16.872284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:16.875410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:16.876293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:16.883443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 181/360] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:16.883443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.909408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 180/361] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:16.910546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:16.918123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:16.972688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.020549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804a43-0f19-49bb-964b-b0c0512a7e3e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.035019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b7839-a03d-4cca-94b1-588c4c90c491 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.075463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.076313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.076598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.076872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.081810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.082466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.082749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.083026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.092603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:17.100635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:17.101589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:17.102470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 182/362] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:17.103206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.173506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.174996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.228309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.243229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424ac5c-c98d-4ace-b4ac-57aac13f6a42 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.244439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.293805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.295290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.295769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.296317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] PATH_INFO: `/v3/users/bcbb48d9efbe4f55a03e499fe51202db` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.297759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] RBAC: Authorizing `identity:get_user(user_id=bcbb48d9efbe4f55a03e499fe51202db)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.300709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.308112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 183/363] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/users/bcbb48d9efbe4f55a03e499fe51202db => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:17.309267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.312722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 181/364] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:17.313686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.451214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4d474-7353-42a5-8062-6eff95ebd64b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.451350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b545f-a38e-46d1-a801-7192adce62ee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.499231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.499960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.500199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.500572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.501084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.501403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:17.501708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.501875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.502162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.502438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.503233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.510299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 184/365] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=d8c3658111d243bf9e85b889e49a811e => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:17.511444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.517386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:17.526067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:17.527039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:17.528297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:17.530642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 182/366] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:17.531745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.544271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.554631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.641999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14acb7-c6df-4c36-a7d7-0eac71e6abd6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.654390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1184f-3799-4206-b174-18e8caa59bb0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.687300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.688357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.688892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.689373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.690345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:17.690855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.693679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.695409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.696126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.696408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.696755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.697858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] RBAC: Adding query filter params (role.id=66769d42dee44f55bf70f0358516a8d6, user.id=bcbb48d9efbe4f55a03e499fe51202db, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:17.698168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.699730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.713069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 185/367] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:17.714418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.714835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 183/368] 10.222.0.44 () {56 vars in 1308 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/role_assignments?user.id=bcbb48d9efbe4f55a03e499fe51202db&scope.system=all&role.id=66769d42dee44f55bf70f0358516a8d6 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:17.715672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.797088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.835119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06f00-8bef-4cef-bdd9-31ee0afc04fe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.856239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:17.879186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed89c-9aed-48b6-878e-31cd0a407f9e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:17.880274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.881190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.883410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.883952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.884943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:17.885441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.888022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.906888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 184/369] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:17.908831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:17.960678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:17.963309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:17.964170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:17.965511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:17.967464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:17.971778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:17.976444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 186/370] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:17.978243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.107450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e345f8-e494-4704-8235-1b441f8f56da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.132804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237f9f7-4060-4036-b439-b37eb1993a3a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.140727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:18.147780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.149188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.149871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.150560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.172371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.172779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.173064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.173340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.212231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:18.266806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.269058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.274428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.276068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.396705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 185/371] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:18.397888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.413260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 187/372] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:18.414297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.438462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:18.490973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:18.539056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61085e3b-73a1-4ec9-94ea-778c81ef4afc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.558951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a463b-717b-43ef-b722-6acc66ca6ff9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.584992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.585959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.586247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.586521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.587857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.589290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.591155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 186/373] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:18.592183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.606091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b5c10-341e-4b48-adad-6066d40dedcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.606961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5c10-341e-4b48-adad-6066d40dedcf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.607241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5c10-341e-4b48-adad-6066d40dedcf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.607519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b5c10-341e-4b48-adad-6066d40dedcf None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.608751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b5c10-341e-4b48-adad-6066d40dedcf None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.610357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b5c10-341e-4b48-adad-6066d40dedcf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.612035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 188/374] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:18.613180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971e32-bb50-4a34-9d96-be4125ce048d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.613654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971e32-bb50-4a34-9d96-be4125ce048d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.613772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971e32-bb50-4a34-9d96-be4125ce048d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.616244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 189/375] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:18.617284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971e32-bb50-4a34-9d96-be4125ce048d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.715597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:18.719111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa154c4b-6354-4316-8b77-b1ba1ee92c74 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.750920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971e32-bb50-4a34-9d96-be4125ce048d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.762152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.763143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.763427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.763699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] PATH_INFO: `/v3/projects/fdda7d022db54add9754a061e49ddfb7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.766047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] RBAC: Authorizing `identity:get_project(project_id=fdda7d022db54add9754a061e49ddfb7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.767671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.769840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 187/376] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/projects/fdda7d022db54add9754a061e49ddfb7 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:18.770359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:18.771920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.791207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.791890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.792180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.792512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.793343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:18.793694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.795227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4264d6-066c-4a33-98c8-3340ab949ffb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.803157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 190/377] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=d8c3658111d243bf9e85b889e49a811e => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:18.804816 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.805408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.806139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.825641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:18.827020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:18.896379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eceaed-24f7-485a-87d7-70e4ec091246 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:18.920007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 191/378] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:18.921049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:18.950253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:18.951727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:18.952278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:18.952804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:18.954466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:18.955976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:18.957672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 188/379] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:18.958520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.017620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:19.063369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ab73-18e3-4b13-b20f-a4c0d2f57694 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.084179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:19.105379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7b801-4c9e-497f-9393-c8cdfcd50166 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.113290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.114160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.114606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.114880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] PATH_INFO: `/v3/groups/9171e37f62904e8e989f54cf1c983088` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.123122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] RBAC: Authorizing `identity:get_group(group_id=9171e37f62904e8e989f54cf1c983088)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:19.124922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:19.127486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 192/380] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/groups/9171e37f62904e8e989f54cf1c983088 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:19.131840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.157274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.158748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.159242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.159908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.174900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:19.185404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:19.186345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:19.187159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:19.189273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 189/381] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:19.192100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.253235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b96370-73e6-41c1-9e50-c9808efdfa81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.292668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.293853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.294341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.294940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.295883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:19.297608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:19.298217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:19.299901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:19.301483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e829af-f202-4120-b5ec-8094d521c2b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.306968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 193/382] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:19 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:19.323826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.356536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:19.369148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.369867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.370151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.370428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.371271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] RBAC: Adding query filter params (group.id=9171e37f62904e8e989f54cf1c983088, role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=fdda7d022db54add9754a061e49ddfb7) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:19.371584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:19.373131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:19.384930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 190/383] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:19 2022] GET /identity/v3/role_assignments?group.id=9171e37f62904e8e989f54cf1c983088&scope.project.id=fdda7d022db54add9754a061e49ddfb7&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:19.431374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77d7c-8699-49f0-bfac-69c20bb1b796 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.473433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.474740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.475096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.475383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.476328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:19.476644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:19.478222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:19.488282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 194/384] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:19.494493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.621199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb93c1-73db-4283-819e-11fd05e1437f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.673719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.674622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.674902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.675175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.676483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:19.678049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:19.680117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 191/385] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:19 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:19.685629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.798731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875558b-3709-4542-9724-803b80205bf1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:19.800351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:19.834422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c4ba8-02b9-4fbb-a958-7f3dfb4bf0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:19.835290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c4ba8-02b9-4fbb-a958-7f3dfb4bf0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:19.835575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c4ba8-02b9-4fbb-a958-7f3dfb4bf0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:19.835878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c4ba8-02b9-4fbb-a958-7f3dfb4bf0a2 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:19.837264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c4ba8-02b9-4fbb-a958-7f3dfb4bf0a2 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:19.838721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c4ba8-02b9-4fbb-a958-7f3dfb4bf0a2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:19.840796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 195/386] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:19 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:19.846591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:19.877460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:19.966942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b171063-b859-4c86-b27e-da38370e3f08 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:20.010590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1393f-4833-43a7-abd6-b859c43b69e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:20.011498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1393f-4833-43a7-abd6-b859c43b69e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:20.011784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1393f-4833-43a7-abd6-b859c43b69e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:20.012086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1393f-4833-43a7-abd6-b859c43b69e7 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/groups/0058189418cd443592be69c00e15e9e8/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:20.014184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1393f-4833-43a7-abd6-b859c43b69e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f, group_id=0058189418cd443592be69c00e15e9e8, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:20.015676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1393f-4833-43a7-abd6-b859c43b69e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:20.100903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 192/387] 10.222.0.44 () {58 vars in 1442 bytes} [Tue May 24 09:55:19 2022] PUT /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/groups/0058189418cd443592be69c00e15e9e8/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:20.228585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b5e6-69b6-4182-b4b1-97259f2730a6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:20.228888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b5e6-69b6-4182-b4b1-97259f2730a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:20.229119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b5e6-69b6-4182-b4b1-97259f2730a6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:20.230766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 196/388] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:20.236301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:20.236649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:20.236937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:20.261923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:20.263141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:20.352128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 193/389] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:20.393358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79b5e6-69b6-4182-b4b1-97259f2730a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:20.525876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79b5e6-69b6-4182-b4b1-97259f2730a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:20.564491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:20.565309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:20.565590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:20.565863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:20.577468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:20.585970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:20.586874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:20.588154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 197/390] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:20.594991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:20.620430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:20.740229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f1a66-0cbc-4e9d-b954-0cb5f0c19d60 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:20.788809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:20.789406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:20.789693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:20.789972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:20.790728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:20.791038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:20.792450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:20.801183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 194/391] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:20.807699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:20.869764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:20.976007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86b133-77fd-4652-8093-554ab8e05853 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:21.025856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:21.026721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.027005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.027284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.028490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:21.029947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:21.031893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 198/392] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:20 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:21.037771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:21.167440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:21.199365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b3d0-22bb-4ab9-88df-605d5987fbdb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:21.249038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1a588-bbbc-4d24-88e8-8068884a98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:21.250258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a588-bbbc-4d24-88e8-8068884a98b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.250737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a588-bbbc-4d24-88e8-8068884a98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.251207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1a588-bbbc-4d24-88e8-8068884a98b5 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.253720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a588-bbbc-4d24-88e8-8068884a98b5 None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:21.255926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1a588-bbbc-4d24-88e8-8068884a98b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:21.257817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 195/393] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:21 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:21.263520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:21.336501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a4beb-e08d-4dee-8e17-475aa314b3cd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.337151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a4beb-e08d-4dee-8e17-475aa314b3cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.337852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a4beb-e08d-4dee-8e17-475aa314b3cd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.339403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 196/394] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:21.344980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.345506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.345885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.372013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:21.373218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:21.398864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:21.403204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a0375-60fc-4984-a394-1758fcdbf2b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:21.441493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:21.443149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.443580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.444027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/groups/0058189418cd443592be69c00e15e9e8/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.446478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] RBAC: Authorizing `identity:create_grant(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f, group_id=0058189418cd443592be69c00e15e9e8, role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:21.449056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:21.498933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 197/395] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:21.518224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 199/396] 10.222.0.44 () {58 vars in 1442 bytes} [Tue May 24 09:55:21 2022] PUT /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f/groups/0058189418cd443592be69c00e15e9e8/roles/d8c3658111d243bf9e85b889e49a811e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:21.552679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:21.668103 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:21.697294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f896297-9e60-4b6e-9790-a90fd71da7ab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:21.752978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:21.753822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.754107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.754380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.775519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:21.784332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:21.785464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:21.787265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 198/397] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:21.794283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:21.919513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0504e-cfbf-41ef-8fd9-3276d029db99 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:21.955763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:21.956680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:21.957109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:21.957551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:21.958494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:21.958945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:21.960512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a603ba-f4e3-4cc9-b41e-8ee75b39fac1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:21.969381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 200/398] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:21.975630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.028712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31838617-d661-45b1-8b85-199c898ca292 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.029256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31838617-d661-45b1-8b85-199c898ca292 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.029693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31838617-d661-45b1-8b85-199c898ca292 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.031202 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 201/399] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:22.037053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.037560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.037983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.066457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:22.068837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:22.102949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:22.151307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7193bc5-9eb6-4a92-b094-c8bb5f36edd5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:22.215897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 202/400] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:22.229249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:22.230379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.230828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.231263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.232668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:22.234292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:22.236395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 199/401] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:21 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:22.239071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.244461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.257535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:22.347553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc0908-5576-4bef-b481-d652ce9bc140 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:22.383754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d75a7a-50aa-45c4-9f18-53911a39b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:22.384939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75a7a-50aa-45c4-9f18-53911a39b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.385425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75a7a-50aa-45c4-9f18-53911a39b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.385951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d75a7a-50aa-45c4-9f18-53911a39b9d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.397484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d75a7a-50aa-45c4-9f18-53911a39b9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-66d75a7a-50aa-45c4-9f18-53911a39b9d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:22.405862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:22.407022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:22.408137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:22.410075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 203/402] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:22.412073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca9c3-2cd8-450f-9172-68c0783b394e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.412462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca9c3-2cd8-450f-9172-68c0783b394e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.412837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca9c3-2cd8-450f-9172-68c0783b394e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.418325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 204/403] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:22.418325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca9c3-2cd8-450f-9172-68c0783b394e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.426930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493757-a2a2-44fc-a4ee-1055c5a82293 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:22.440482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:22.469496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb972464-23c0-4063-bb30-f72294e00b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:22.470528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb972464-23c0-4063-bb30-f72294e00b6b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.470968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb972464-23c0-4063-bb30-f72294e00b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.471347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb972464-23c0-4063-bb30-f72294e00b6b None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.472877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb972464-23c0-4063-bb30-f72294e00b6b None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:22.475989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb972464-23c0-4063-bb30-f72294e00b6b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:22.478151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 200/404] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:22 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:22.479445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.479883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.480295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.501454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:22.503017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:22.550905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca9c3-2cd8-450f-9172-68c0783b394e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:22.583821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 201/405] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:22.583821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.587480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:22.605679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:22.606569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.607024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.607435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.608358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:22.608803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:22.610314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:22.619673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 205/406] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:22.626198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.709756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497ab9-c4ad-4269-8e2a-beabde6deb6c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:22.719189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:22.750645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:22.750645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.750645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.750645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/groups/0058189418cd443592be69c00e15e9e8/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.752551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6da103650dc4f5396b0baa0a0050e9a, group_id=0058189418cd443592be69c00e15e9e8, role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:22.754248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:22.758948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f74f4a-4070-428c-a6f5-37c558e2459a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:22.799747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:22.801345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:22.802584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:22.803041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:22.814292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:22.822353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:22.823513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:22.824348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:22.830182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 206/407] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:22.831052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.852696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 202/408] 10.222.0.44 () {58 vars in 1442 bytes} [Tue May 24 09:55:22 2022] PUT /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/groups/0058189418cd443592be69c00e15e9e8/roles/d8c3658111d243bf9e85b889e49a811e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:22.858938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:22.982648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:22.988046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0d489-f15e-4dcb-8ed4-cc5f2cb9d841 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.021660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:23.028311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83469026-878b-4981-b89f-674f274d0eb0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.032008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3186bb-0142-4cf7-a562-2f2cd537a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.032898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3186bb-0142-4cf7-a562-2f2cd537a508 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.033238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3186bb-0142-4cf7-a562-2f2cd537a508 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.033520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3186bb-0142-4cf7-a562-2f2cd537a508 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.034823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3186bb-0142-4cf7-a562-2f2cd537a508 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.037697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3186bb-0142-4cf7-a562-2f2cd537a508 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.040302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 207/409] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:22 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:23.042100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f1ca-1b64-4b43-8d43-54be66362476 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.042394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f1ca-1b64-4b43-8d43-54be66362476 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.042683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f1ca-1b64-4b43-8d43-54be66362476 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.047891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 208/410] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:23.048747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f1ca-1b64-4b43-8d43-54be66362476 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.082374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.084372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.085382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.086193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.087561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:23.088235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.090279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8a850-6f67-47e8-bc6e-0d25f620d041 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.103761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 203/411] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:23.106376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.106901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.107491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.127929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:23.129557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:23.170808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f1ca-1b64-4b43-8d43-54be66362476 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.207726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.209201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.209485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.209757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.210949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.215787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.215787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 209/412] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:23 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:23.215787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.216452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 204/413] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:23.220430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.285632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:23.300797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:23.323003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aabc9e-30b6-4cf0-91fe-39353095d262 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.349304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec1fe3-7983-4904-8acc-8a5308d2bb17 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.360409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.361566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.362116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.362564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] PATH_INFO: `/v3/groups/9171e37f62904e8e989f54cf1c983088` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.363954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] RBAC: Authorizing `identity:get_group(group_id=9171e37f62904e8e989f54cf1c983088)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.366484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.368673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 210/414] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:23 2022] GET /identity/v3/groups/9171e37f62904e8e989f54cf1c983088 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:23.369733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.387979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.388866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.389151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.389595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/groups/0058189418cd443592be69c00e15e9e8/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.391691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6da103650dc4f5396b0baa0a0050e9a, group_id=0058189418cd443592be69c00e15e9e8, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.393273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.456853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 205/415] 10.222.0.44 () {58 vars in 1442 bytes} [Tue May 24 09:55:23 2022] PUT /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a/groups/0058189418cd443592be69c00e15e9e8/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:55:23.465470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.501049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb65185-f04d-48f0-b944-c9a4a77c9fe4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.545565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.546349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.546637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.546953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.551156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:23.563248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:23.574412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:23.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:23.576360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 211/416] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:23.583964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.684193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f630-d74e-455c-8a05-0f9525e07119 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.710420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:23.741877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.743155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.743681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.744092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] PATH_INFO: `/v3/projects/fdda7d022db54add9754a061e49ddfb7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.745734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] RBAC: Authorizing `identity:get_project(project_id=fdda7d022db54add9754a061e49ddfb7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.749236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.750191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 206/417] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:23 2022] GET /identity/v3/projects/fdda7d022db54add9754a061e49ddfb7 => generated 344 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:23.756191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.799600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcbeb0-094a-4d9a-bd1d-b082c63c64e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.845572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.846903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.847322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.847751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.849221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:23.849711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.851284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.860673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 212/418] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:23.868762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:23.893039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7071c-dcf9-4b0e-841f-184a949662fc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:23.934914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:23.936343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:23.936707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:23.937060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] PATH_INFO: `/v3/projects/fdda7d022db54add9754a061e49ddfb7/groups/9171e37f62904e8e989f54cf1c983088/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:23.939484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdda7d022db54add9754a061e49ddfb7, group_id=9171e37f62904e8e989f54cf1c983088, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:23.941290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:23.980213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:24.019756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 207/419] 10.222.0.44 () {58 vars in 1442 bytes} [Tue May 24 09:55:23 2022] PUT /identity/v3/projects/fdda7d022db54add9754a061e49ddfb7/groups/9171e37f62904e8e989f54cf1c983088/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:24.034779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e9e8f-ee93-450d-8072-33c13de2fac6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:24.083485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff001d-7911-4b0d-8752-25a43ec4368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:24.084231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff001d-7911-4b0d-8752-25a43ec4368d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.084504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff001d-7911-4b0d-8752-25a43ec4368d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.084768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff001d-7911-4b0d-8752-25a43ec4368d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.164764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff001d-7911-4b0d-8752-25a43ec4368d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:24.166340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff001d-7911-4b0d-8752-25a43ec4368d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:24.244061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:24.285278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 213/420] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:55:24.291732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:24.333902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc088-a178-4ac1-afaf-3b374e47a18a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.334158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc088-a178-4ac1-afaf-3b374e47a18a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.334391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bc088-a178-4ac1-afaf-3b374e47a18a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.335904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 214/421] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:24.341112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.341625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.342119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.345272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:24.360248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:24.361725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:24.412430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a84fa-a8b4-44a6-9485-fc7199854108 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:24.439999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 215/422] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:24.467579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:24.469057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.469522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.470755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:24.481393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.484316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:24.486702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:24.492656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 208/423] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:24 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:24.496091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:24.625781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:24.634062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8636080-fcc1-4fa8-b128-9b89ec7df69d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:24.671168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:24.672374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.672838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.673559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.687241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:24.698015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:24.698974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:24.699834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:24.702311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 216/424] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:24.707684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:24.756346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b01d13-86c6-4c42-b7ca-c49e8a53f72a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:24.787014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:24.832879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:24.833758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.834040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.834316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.837449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:24.838903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:24.840882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 209/425] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:24 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:24.846238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:24.886717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083c9e5-1c3f-4d16-b171-c1decc1c1968 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:24.946298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:24.946980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:24.947271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:24.947823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:24.948804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:24.949121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:24.957275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:24.967898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61baa3f-5d90-4b37-82b5-7c14f2330860 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:24.980129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 217/426] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:24.981055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:24.996910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:25.073409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.074488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.074973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.075475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.076579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:25.077118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:25.078834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:25.095148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 210/427] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:24 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:25.099816 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7810d-eab0-4d08-8a60-1b7860c84957 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:25.140626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6ade9-0bdd-4856-b845-a3b23d1a0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.141214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ade9-0bdd-4856-b845-a3b23d1a0408 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.141496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ade9-0bdd-4856-b845-a3b23d1a0408 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.141780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6ade9-0bdd-4856-b845-a3b23d1a0408 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.218262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6ade9-0bdd-4856-b845-a3b23d1a0408 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:25.219768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6ade9-0bdd-4856-b845-a3b23d1a0408 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:25.232762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:25.327546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 218/428] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:25.334008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:25.342926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff42f-7b01-4f42-8139-cc0a761ebb0f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.344195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff42f-7b01-4f42-8139-cc0a761ebb0f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.344480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff42f-7b01-4f42-8139-cc0a761ebb0f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.346182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 219/429] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:25.354749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.355066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.355326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.375954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:25.377651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:25.399609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:25.479094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 220/430] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:25.491681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1722cc-8ef3-4f31-95dd-0d93dcbe96c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:25.506561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:25.533845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.534876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.535167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.535450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] PATH_INFO: `/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.537044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] RBAC: Authorizing `identity:get_project(project_id=46e0f0b031ff4ea78f43b9ca0f0ca26f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:25.538693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:25.541172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 211/431] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:25 2022] GET /identity/v3/projects/46e0f0b031ff4ea78f43b9ca0f0ca26f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:25.549101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:25.555353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:25.638050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe3a28-3d43-4273-9a33-a61dab4914d0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:25.679772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80320e-9003-45ea-a445-669cf2a7499e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:25.686351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.687736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.688057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.688340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.694291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:25.704183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:25.715769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:25.716783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:25.717602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 221/432] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:25.723013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:25.724883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.725998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.726798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.728074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.732393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:25.733900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:25.735888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 212/433] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:25 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:25.742003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:25.837629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:25.840640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63798-8e0f-4a1d-ad1f-9f6316da61a2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:25.861959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091fcfe-18ba-41a4-ab4b-d748e90c8768 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:25.880864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.881542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.881827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.882105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.882855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:25.883163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:25.884589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:25.893429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 222/434] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:25.898988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:25.904408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:25.905128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:25.905412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:25.905689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:25.906571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:25.906888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:25.912470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:25.920057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 213/435] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:25 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=46e0f0b031ff4ea78f43b9ca0f0ca26f&role.id=d8c3658111d243bf9e85b889e49a811e => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:26.021038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c7042-28f7-49bc-a559-3fc1eed5f976 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:26.059539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1f7b-788a-43c4-8d49-ca6c6513ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:26.060230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1f7b-788a-43c4-8d49-ca6c6513ce97 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.060511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1f7b-788a-43c4-8d49-ca6c6513ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.060784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1f7b-788a-43c4-8d49-ca6c6513ce97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.095053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:26.137377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1f7b-788a-43c4-8d49-ca6c6513ce97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:26.138860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1f7b-788a-43c4-8d49-ca6c6513ce97 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:26.251907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 223/436] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:26.257421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.305508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:26.355247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add33a56-3cb5-4334-aeca-08b7325c0c96 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.355548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add33a56-3cb5-4334-aeca-08b7325c0c96 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.355787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add33a56-3cb5-4334-aeca-08b7325c0c96 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.357482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 224/437] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:26.362487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.363033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.363483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.371447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20757d77-ac88-429e-aa48-87382b99f4d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:26.388306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:26.389496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:26.420009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:26.421142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.421428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.421709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.423826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:26.425477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:26.427394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 214/438] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:26.432931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.478711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:26.493336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 225/439] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:26.517605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.551622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdce3b-c538-487a-bdee-5e33aba1a7ad None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:26.567864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:26.592613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:26.594023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.594318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.594591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.595945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:26.597441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:26.600043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 215/440] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:26.605674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.640321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d798-5dbc-41d9-8277-54a90f9b6dc5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:26.678377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:26.679319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.679602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.679908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.690578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:26.698902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:26.699947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:26.700779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 226/441] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:26.705674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.719768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f6f07-81d1-4456-88de-691eddee2247 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:26.759646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:26.760393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.760683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.760968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.761800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:26.762463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:26.762909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:26.763665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afe59b-c193-428c-9ec6-05a81763a7f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:26.770208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 216/442] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=d8c3658111d243bf9e85b889e49a811e => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:26.777333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a9b37-54eb-4cae-9bb5-4a0b02f41b28 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.777631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a9b37-54eb-4cae-9bb5-4a0b02f41b28 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.777920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a9b37-54eb-4cae-9bb5-4a0b02f41b28 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.779499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 217/443] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:26.785484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.785784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.786639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.805635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:26.806865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:26.820556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820020-5baa-4c1f-bc3c-bdd1dd1b9a6a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:26.856443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:26.859093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:26.859964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:26.860102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:26.860596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:26.861078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:26.861383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:26.862798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:26.872319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 227/444] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:26.877646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.893236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 218/445] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:26.918665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:26.991295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773c1c-7c2a-4149-afb9-d44b102ca326 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.008515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.029369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.030022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.030309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.030586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.031627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b4a38-0dcd-4a71-8f35-9c149405b34e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.065541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.066315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.066594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.066864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.077723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:27.085374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:27.086444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:27.087441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 219/446] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:27.092098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.100643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.102107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.125255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.189790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478e759-a9f5-4914-b47f-aec8e6fd622c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.197845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 228/447] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:55:27.203477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.217809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.224302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.224965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.230672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.230672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.230672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:27.230672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.230672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.236461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 220/448] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:27.242190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.302840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b7806-b769-4a20-bb64-9ac0d464caa1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.335117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.336849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.337697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.337976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.338247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] PATH_INFO: `/v3/projects/f6da103650dc4f5396b0baa0a0050e9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.339413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] RBAC: Authorizing `identity:get_project(project_id=f6da103650dc4f5396b0baa0a0050e9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.340819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0796-7fba-40bd-aa23-8a4388959101 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.340914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.342748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 229/449] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/projects/f6da103650dc4f5396b0baa0a0050e9a => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:27.348849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.375524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.376220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.376504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.376782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.429067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.446874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa8f98-862e-4a09-8194-e732ba594b98 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.448549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.450015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.480969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.481827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.482112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.482390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] PATH_INFO: `/v3/groups/0058189418cd443592be69c00e15e9e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.483573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] RBAC: Authorizing `identity:get_group(group_id=0058189418cd443592be69c00e15e9e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.485069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.486694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 230/450] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/groups/0058189418cd443592be69c00e15e9e8 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:27.493207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.540694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.547036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 221/451] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:55:27.552565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.591407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014b3d-4b5d-480e-917b-5b7b17658df1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.624352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.624994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.625275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.625546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.626358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] RBAC: Adding query filter params (group.id=0058189418cd443592be69c00e15e9e8, role.id=ee2edaaf7e5e4667880cd978b8cc1137, scope.project.id=f6da103650dc4f5396b0baa0a0050e9a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:27.626664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.628141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.633902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 231/452] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/role_assignments?group.id=0058189418cd443592be69c00e15e9e8&scope.project.id=f6da103650dc4f5396b0baa0a0050e9a&role.id=ee2edaaf7e5e4667880cd978b8cc1137 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:27.652923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef60d0c-4cf9-4792-a6c9-0ccf5d8bdf05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.691258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.692322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.692829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.693250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] PATH_INFO: `/v3/projects/fdda7d022db54add9754a061e49ddfb7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.694591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] RBAC: Authorizing `identity:get_project(project_id=fdda7d022db54add9754a061e49ddfb7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.696129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.698173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 222/453] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/projects/fdda7d022db54add9754a061e49ddfb7 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:27.703954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.726058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.814498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda10d-1c73-4c0a-a4d9-5dcf89bc6f90 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:27.852463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8712c-260d-4a55-86b1-c51a64ee2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:27.853285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8712c-260d-4a55-86b1-c51a64ee2abf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:27.853570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8712c-260d-4a55-86b1-c51a64ee2abf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:27.853849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8712c-260d-4a55-86b1-c51a64ee2abf None admin] PATH_INFO: `/v3/groups/9171e37f62904e8e989f54cf1c983088` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:27.855039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8712c-260d-4a55-86b1-c51a64ee2abf None admin] RBAC: Authorizing `identity:get_group(group_id=9171e37f62904e8e989f54cf1c983088)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:27.856512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8712c-260d-4a55-86b1-c51a64ee2abf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:27.859061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 232/454] 10.222.0.44 () {56 vars in 1180 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/groups/9171e37f62904e8e989f54cf1c983088 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:27.864769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:27.931668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:27.970526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72214fc6-3848-4bc0-b6ee-382af24426c5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:28.008139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:28.008799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:28.009084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:28.009365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:28.010196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] RBAC: Adding query filter params (group.id=9171e37f62904e8e989f54cf1c983088, role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=fdda7d022db54add9754a061e49ddfb7) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:28.010514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:28.011980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c70d7-ba70-4730-98b2-0304085a900a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:28.018381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 223/455] 10.222.0.44 () {56 vars in 1376 bytes} [Tue May 24 09:55:27 2022] GET /identity/v3/role_assignments?group.id=9171e37f62904e8e989f54cf1c983088&scope.project.id=fdda7d022db54add9754a061e49ddfb7&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:30.750082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0e12d-c862-42e8-8cee-6009ffb08bc7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:30.751073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0e12d-c862-42e8-8cee-6009ffb08bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:30.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0e12d-c862-42e8-8cee-6009ffb08bc7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:30.753589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 233/456] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:30.758748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdf9ac-a5db-4fa2-8b41-07e5a4bd0f77 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:30.759574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdf9ac-a5db-4fa2-8b41-07e5a4bd0f77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:30.760157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdf9ac-a5db-4fa2-8b41-07e5a4bd0f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:30.784787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-20fdf9ac-a5db-4fa2-8b41-07e5a4bd0f77 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:30.786932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20fdf9ac-a5db-4fa2-8b41-07e5a4bd0f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:30.881391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 224/457] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:30.920517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0e12d-c862-42e8-8cee-6009ffb08bc7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.032892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:31.061428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0e12d-c862-42e8-8cee-6009ffb08bc7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.089113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4202-466a-4f22-9fd9-b78d1d7d428d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.089438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4202-466a-4f22-9fd9-b78d1d7d428d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.089633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd4202-466a-4f22-9fd9-b78d1d7d428d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.094979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 225/458] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:31.096838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e737-fb30-4b54-9b83-09e1977ba322 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.097129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e737-fb30-4b54-9b83-09e1977ba322 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.097413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566e737-fb30-4b54-9b83-09e1977ba322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.111220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.112055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.112340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.112618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.129640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c566e737-fb30-4b54-9b83-09e1977ba322 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:31.131435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c566e737-fb30-4b54-9b83-09e1977ba322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:31.137679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.139181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7c19540c-0b6f-4927-865d-1ee9c85bb733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:31.160134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:31.161072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:31.163082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:31.163082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:31.163082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:31.163082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:31.163082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 234/459] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:31.168321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be535-7f77-4f5c-8140-5cce07e23e95 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.168637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be535-7f77-4f5c-8140-5cce07e23e95 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.169046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97be535-7f77-4f5c-8140-5cce07e23e95 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.175236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 235/460] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:31.175236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be535-7f77-4f5c-8140-5cce07e23e95 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.205670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:31.219940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 226/461] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:31.221234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.221520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.221800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.257174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:31.258423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:31.288231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97be535-7f77-4f5c-8140-5cce07e23e95 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.326115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.326785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.327070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.327349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.328098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:31.328504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.330015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.331987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:31.334281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 227/462] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:31.335138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.350797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 236/463] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:31.356103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.439321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836039c1-ebe7-4c26-9226-676900c1d81c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.462797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:31.472943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7eb87c-0891-4c43-bd66-1190c56489b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.482711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.483721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.484195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.484611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.496331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.498078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.511091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.514859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.514859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.514859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.514859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.514859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:31.518084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:31.519072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:31.520101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:31.520101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:31.520101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:31.520101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:31.526403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 228/464] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:31.527450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.634242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 237/465] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:31 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:55:31.634904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.643344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036d6d-cc5e-42c9-9877-bea00f0f916b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.685623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.686579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.686916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.687393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.700900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.703149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.707873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f2ce0ae3-2e1e-4e11-a97f-a61687403b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:31.724501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:31.725599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:31.726728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:31.726728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:31.726728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:31.726728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:31.728457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 229/466] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:31.730020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721822-4261-49db-bf3e-dc3dfacef390 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.730506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721822-4261-49db-bf3e-dc3dfacef390 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.730992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1721822-4261-49db-bf3e-dc3dfacef390 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.732926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 230/467] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:31.734192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1721822-4261-49db-bf3e-dc3dfacef390 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.772326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:31.780944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0258a-3356-4eb9-866a-fe392c0f51a3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.831761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.832596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.832948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.835026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.835592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:31.835933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.837441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb3ac7-11bb-49de-a89d-76b3cd4f148e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.853038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 238/468] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:31.854382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.854679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.854962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.871326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1721822-4261-49db-bf3e-dc3dfacef390 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:31.874809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:31.876048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:31.918375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:31.918979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:31.919244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:31.919517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:31.920251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:31.920559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:31.922031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:31.936507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 231/469] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:31.936911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:31.979971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 239/470] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:31.980888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:32.042249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:32.057180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:32.081101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8a97-b054-43d3-a785-b88e919fb01b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.107906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85d60e-0977-4d36-a54a-802b8aee9a7f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.128934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.130162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.130611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.130968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.131749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:32.133875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:32.151454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63edf14-a918-48ac-a298-36e9636d0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.152160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edf14-a918-48ac-a298-36e9636d0aab None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.152447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edf14-a918-48ac-a298-36e9636d0aab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.152725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63edf14-a918-48ac-a298-36e9636d0aab None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.153429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63edf14-a918-48ac-a298-36e9636d0aab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:32.154892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63edf14-a918-48ac-a298-36e9636d0aab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:32.203901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 232/471] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:31 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:32.203901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:32.221005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 240/472] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:31 2022] POST /identity/v3/users => generated 248 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:32.226040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d677f-c75b-4f60-a71c-6f98309140dd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.226040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d677f-c75b-4f60-a71c-6f98309140dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.226040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d677f-c75b-4f60-a71c-6f98309140dd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.226040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 241/473] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:32.231546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.231867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.232142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.256635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:32.257908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:32.373469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 242/474] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:32.402332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca77aab-5b1c-4d12-883a-c4bc1a537dcc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.418193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:32.455071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.456247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.456752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.457268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.457967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:32.476883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:32.481831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:32.483288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:32.512577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:32.514910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:32.515759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:32.515759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:32.515759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:32.515759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:32.515759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 233/475] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:32.521871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:32.567009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94699e36-b9f4-4e80-a4ac-1af1c1a65b64 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.605696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.606366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.606645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.606917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.607665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:32.609199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:32.654589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 09:55:32.654589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 24 09:55:32.654589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [parameters: {'id': 'd6d3d92e30a24f62a4961b6ebca16459', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 24 09:55:32.654589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 09:55:32.662985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db566f9-e01f-4ba2-b8a5-3da887efa097 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() May 24 09:55:32.673476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return ref.to_dict() May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:55:32.674412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 09:55:32.675728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 09:55:32.677431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application c = connection._execute_20( May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:55:32.678514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:55:32.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'id': 'd6d3d92e30a24f62a4961b6ebca16459', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:32.681487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 24 09:55:32.683682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:32.687676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 243/476] 10.222.0.44 () {60 vars in 1131 bytes} [Tue May 24 09:55:32 2022] POST /identity/v3/roles => generated 144 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:32.687676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:32.768800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.769190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.769474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.769748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.770481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:32.771081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:32.772453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:32.799373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:32.810227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 234/477] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:32.812751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:32.822378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb4cb-02ff-486a-bb30-4131cb0baf66 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.877165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:32.934930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f573c-adab-4229-87f1-719276aefe5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:32.939602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.940466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.940754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.941035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.971006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:32.979461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:32.980443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 24 09:55:32.981250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:32.982621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901daa1-43e3-4b5e-af14-8805230827e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:32.983541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901daa1-43e3-4b5e-af14-8805230827e3 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:32.984073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901daa1-43e3-4b5e-af14-8805230827e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:32.984543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901daa1-43e3-4b5e-af14-8805230827e3 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:32.985478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901daa1-43e3-4b5e-af14-8805230827e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:32.987117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901daa1-43e3-4b5e-af14-8805230827e3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:32.993134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 244/478] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:55:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:33.000796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:33.095956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 235/479] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:32 2022] POST /identity/v3/users => generated 249 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:33.131436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d563-1b84-4877-8afe-d4c3de296644 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:33.175224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:33.176381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:33.176876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:33.177533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:33.178583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:33.179138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:33.180790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c62c8a-f0d3-491c-91d6-d1978325140e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:33.194852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 245/480] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:34.206157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fb77-60dd-4c2d-aba4-cda22e405816 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:34.207216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fb77-60dd-4c2d-aba4-cda22e405816 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:34.207719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fb77-60dd-4c2d-aba4-cda22e405816 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:34.209658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 236/481] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:34.216018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:34.216863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:34.217344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:34.237968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:34.241622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:34.252133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:34.332194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 246/482] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:34.377363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0fb77-60dd-4c2d-aba4-cda22e405816 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:34.537072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0fb77-60dd-4c2d-aba4-cda22e405816 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:34.548266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:34.582708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628835c-45ff-4289-b57d-783a0990e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:34.584147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628835c-45ff-4289-b57d-783a0990e00a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:34.584859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628835c-45ff-4289-b57d-783a0990e00a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:34.585141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628835c-45ff-4289-b57d-783a0990e00a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:34.609047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628835c-45ff-4289-b57d-783a0990e00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c628835c-45ff-4289-b57d-783a0990e00a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:34.617683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:34.618725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:34.620171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 237/483] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:34.628358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:34.780008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6055d2d-fb03-413e-a112-849408e6d86e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:34.793504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e583d6-a26b-430f-ac74-0fdc2c9932f3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:34.793765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e583d6-a26b-430f-ac74-0fdc2c9932f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:34.793982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e583d6-a26b-430f-ac74-0fdc2c9932f3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:34.796154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 238/484] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:34.801166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:34.801614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:34.802508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:34.828407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:34.829594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:34.833037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:34.833750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:34.834034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:34.834309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:34.835056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:34.835363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:34.836780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:34.853314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 247/485] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:34.859079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:34.872223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:34.988665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 239/486] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:35.010609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.078155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafaa9a-e9d2-4432-b85d-724f0d31cbdb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.125355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.126152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.126437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.126765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.135108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:35.141053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb622f0-e75c-4b56-9c59-b94a4b2b2674 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.142910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.145074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1d724f3c-d594-476c-8cd0-6f3acd37db6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:35.170183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:35.171073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:35.172028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:35.172028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:35.172028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:35.172028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:35.178200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 248/487] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:35.180452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf3c7-aca1-4198-ac04-f17bae8f3f75 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.180744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf3c7-aca1-4198-ac04-f17bae8f3f75 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.181120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf3c7-aca1-4198-ac04-f17bae8f3f75 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.183244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 249/488] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:35.183981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf3c7-aca1-4198-ac04-f17bae8f3f75 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.187923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8b9f6-bf66-4b5c-9b3a-b7268fe7fcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.189200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8b9f6-bf66-4b5c-9b3a-b7268fe7fcca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.189577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8b9f6-bf66-4b5c-9b3a-b7268fe7fcca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.189931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8b9f6-bf66-4b5c-9b3a-b7268fe7fcca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.202445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8b9f6-bf66-4b5c-9b3a-b7268fe7fcca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8ea8b9f6-bf66-4b5c-9b3a-b7268fe7fcca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:35.211213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:35.213428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:35.215070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 240/489] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:35.223858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.223858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.223858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.234543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:35.235892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:35.255377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:35.314600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf3c7-aca1-4198-ac04-f17bae8f3f75 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.320155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 241/490] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:35.321158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.355368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.356805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.357290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.357764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.358683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:35.359728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.361618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:35.383936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 250/491] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:35.384820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.436585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:35.458502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c09123-7664-48a9-baa0-b859ea8f68fd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.499685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.500568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.500856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.501132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.501880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:35.502190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.503573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:35.513053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 242/492] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:35.513916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.531226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414fd1-4084-4edc-992e-8c70f21b1b7b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.554339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:35.577735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.579212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.579792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.580244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.594072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:35.604841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:35.606029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:35.607056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:35.609512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 251/493] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:35.610713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.632848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6b783-26b4-4167-9b3b-2b77e9b5b5dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.671686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.672720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.673056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.673479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.681982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.683607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:35.701364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:35.702460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:35.703596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 243/494] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:35.704928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.716956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:35.744045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85596d88-0c09-47b6-8a35-686d0125cade None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.783708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.784535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.784820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.785136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.796945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.798609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:35.819231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:35.820357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:35.821425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:35.821425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:35.821425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:35.821425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:35.821425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 252/495] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:35.821425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.832526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15297468-ab90-467a-830e-fe677fae8c19 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.857864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:35.886120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.887766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.888595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.889100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.890277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:35.891184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.893345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:35.906937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 244/496] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:35.908248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:35.948563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736669c-4c06-4936-8296-fb6a5c6850c6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:35.986205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:35.986778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:35.987156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:35.987508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:35.988468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:35.988853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:35.991023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.006957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.031619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 253/497] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:36.032497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.046994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e96f74-cdbb-4f17-8782-239027eb65b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.084169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.084879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.085160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.085436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.086155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:36.086461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.087891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dad7fd-6272-4fa1-b4f8-ca5215261a4f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.100185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 245/498] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:36.101560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb0ff-72c8-4dbb-8826-bc689cb62769 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.101851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb0ff-72c8-4dbb-8826-bc689cb62769 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.102126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb0ff-72c8-4dbb-8826-bc689cb62769 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.103506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 246/499] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:36.104289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb0ff-72c8-4dbb-8826-bc689cb62769 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.126009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.140686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834f03a-18ff-4cac-8c3d-43d00d7862a2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.175328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.176147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.176430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.176740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.186689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.188209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.203044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb0ff-72c8-4dbb-8826-bc689cb62769 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7b2e0fd3-32cc-4727-997b-9585bdada40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:36.206509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:36.207383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:36.208813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:36.208813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:36.208813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:36.208813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:36.208813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 254/500] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:36.209697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3411-db7a-492c-b12d-e4b982919250 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.209990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3411-db7a-492c-b12d-e4b982919250 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.210267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3411-db7a-492c-b12d-e4b982919250 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.215650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 255/501] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:36.215650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3411-db7a-492c-b12d-e4b982919250 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.232986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.238628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.244915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.244915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.244915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.306809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.308307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.318847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3411-db7a-492c-b12d-e4b982919250 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.352475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.353255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.353530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.353809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.360679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.362137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.364004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2d0e931d-63cf-40f5-8fce-095c4a168ac9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:36.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:36.381773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:36.382685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 256/502] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:36.383620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a648-dd85-4d7c-9cf1-76e59c22a497 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.383620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a648-dd85-4d7c-9cf1-76e59c22a497 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.383737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4a648-dd85-4d7c-9cf1-76e59c22a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.400954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dfa4a648-dd85-4d7c-9cf1-76e59c22a497 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:36.402134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dfa4a648-dd85-4d7c-9cf1-76e59c22a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:36.410401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 247/503] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:36.411884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.441608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.477652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 257/504] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:36.478958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81578-8793-4191-bacc-79ee598a618f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.479248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81578-8793-4191-bacc-79ee598a618f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.479524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81578-8793-4191-bacc-79ee598a618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.504692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7be81578-8793-4191-bacc-79ee598a618f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:36.505899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7be81578-8793-4191-bacc-79ee598a618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:36.514462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6eb5-07ed-4800-b236-3a1a35e247e6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.547633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.548323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.548605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.548894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.549590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:36.549893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.551247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.563011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 248/505] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:36.564027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.575586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 258/506] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:36.576458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81578-8793-4191-bacc-79ee598a618f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.641675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.656178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.665415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86405-93ea-4aa9-ab51-e2f8fdf20987 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.682932 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81578-8793-4191-bacc-79ee598a618f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.699719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.700425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.700705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.700983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.701813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:36.702122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.703563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.716002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.716790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.717069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.717338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.727709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.729187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.741250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 249/507] 10.222.0.44 () {56 vars in 1137 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:36.742160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:36.746316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:36.747340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:36.748341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:36.748341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:36.748341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:36.748341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:36.748341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 259/508] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:36.748610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.841054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbede0c3-0dea-4c1e-8025-7441b4756555 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.848025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bdf183-95d2-4c7d-84dc-cd83c4d98c41 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:36.858435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:36.875961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.876746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.877030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.877300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.882651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:36.883437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:36.883724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:36.884041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:36.888050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:36.891449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:36.893096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:36.895727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:36.896689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:36.897497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 250/509] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:36.898164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:36.909236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:36.910154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:36.911584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 260/510] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:36.912270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:36.917151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.006899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b7f0-ac90-4e31-aadb-7bb0240d1c61 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.011771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eff06-1e48-4198-88eb-2023d55b4775 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.039861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.040645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.040927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.041200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.045888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.046526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.046809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.047084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.051527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.053951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:37.071202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:37.072252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:37.073408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:37.073408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:37.073408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:37.073408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:37.073408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 251/511] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:37.073408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.093191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.120679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.122163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.131035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.170648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a29533-d4a4-4209-a7fb-024d744f31e2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.205230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.205891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.206202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.206454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.207167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:37.207473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.209684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.220413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 261/512] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:37.225611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 252/513] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:37.225749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.225826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.288336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.319357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea675-c49a-439d-9a4a-ffb6f67e687a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.323161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fc007-047c-40a9-8701-f11cb3783ebc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.342911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.352446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.353111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.353397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.353679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.354418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:37.354727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.356142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.356490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.357153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.357440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.357715 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.358551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:37.358863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.360328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.365167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 262/514] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:37.365796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.378628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 253/515] 10.222.0.44 () {56 vars in 1137 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:37.379449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.470601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f684d-0c46-4a3b-875e-1e1ef37b5485 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.483268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5c27e-88e7-49cf-9b67-35c1d6704232 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.500208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.505102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.505851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.506163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.506441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.507162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:37.510892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.510892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.516855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.517647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.517928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.518208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.525465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 263/516] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:37.525465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.530383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.531884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:37.547016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:37.547989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:37.548873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 254/517] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:37.549373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.588409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.623555 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8838b8-47f6-4013-b80c-16c548c73523 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.650279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f373094-59a3-4d36-a669-2d495351d66e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.657445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.658228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.658510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.658784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.669284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.670753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.683154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.683966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.684254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.684528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:37.688145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:37.689001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:37.689859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:37.689859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:37.689859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:37.689859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:37.692092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 264/518] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:37.694055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.695471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.697101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:37.715238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:37.716318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:37.717210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:37.717210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:37.717210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:37.717210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:37.717210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 255/519] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:37.717210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.745606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.798460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725caa9-4a3f-49ba-9a4f-346308213835 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.808319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:37.817817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7c6e-d238-45e3-90cb-9d3c2d6f5fba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:37.831999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.832642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.832922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.833194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.851613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:37.852309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:37.852596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:37.852874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:37.853574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.855002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.898569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:37.900041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:37.934500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 256/520] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:37 2022] POST /identity/v3/users => generated 247 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:37.935149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:37.945760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.013064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 265/521] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:38.013064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.078697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676956f-d6e0-4ef1-a3d4-d06fb6d1c034 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.117751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.118434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.118718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.118900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f68e7b-06c6-49e6-a16d-f70587de06c1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.118999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.120537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.120537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.121749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.140638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 257/522] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.141470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.153278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.156424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.157359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.157942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.158416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.159306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.159614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.161098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.176811 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 266/523] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.177868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.181725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.254110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea7fc8-7e4e-4fc6-be83-d6cfb8ff7800 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.285431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afbcef-9399-45da-99b5-1780984f4096 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.293076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.293742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.294056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.294306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.295030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.295338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.296753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.308854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 258/524] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.309682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.328635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.330099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.330595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.330978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.342500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.344004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:38.361448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:38.362543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:38.363611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:38.363611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:38.363611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:38.363611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:38.368052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 267/525] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:38.368911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.383229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.421930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f31b6-3c67-43ec-ae95-ad8c095e8434 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.429605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.464308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.464971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.465248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.465517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.466342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6dc6411c631a41d5a22ee51adca2b8f1) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.466650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.468857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.475346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 259/526] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/role_assignments?user.id=6dc6411c631a41d5a22ee51adca2b8f1&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.476168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.491034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a78cc-f2f0-4bec-8ec0-c644a5b702ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.542533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.543907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.544846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.545287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.556476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.559467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:38.578451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:38.579617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:38.580586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:38.581549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 268/527] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:38.582633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.604370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe19575-6914-4540-8a1e-c2bc4e64b596 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.636939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.644256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.645151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.645985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.646348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.655563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.657318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:38.675182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:38.676220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:55:38.677583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:38.681122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 260/528] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:38.681984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.707558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ff07e-3735-4af5-b918-d86ad254293a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.732765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.756255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.756929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.757700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.757978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.758703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.759005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.760442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.778135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 269/529] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.778135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.795360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ce87b-c91e-49e0-9144-28ebca3291fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.832329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.834180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.834751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.835236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.836274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.836813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.838458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.851720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 261/530] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.852821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.888022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdf659-6cb7-40c1-b0b6-e7143d7a18be None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.906033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:38.930762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:38.931435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:38.931723 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:38.932050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:38.932917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:38.933229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:38.934676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:38.954691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 270/531] 10.222.0.44 () {56 vars in 1139 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:38.955558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:38.965079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8038ef-24f5-444a-896f-e91d4024bbc9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:38.998465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:39.013777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.014892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.015182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.015466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.025799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.027495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:39.043789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:39.044732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:39.045629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 262/532] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:39.046661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:39.074088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f6360-ed74-4c37-b419-3b7d2994c52d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:39.124550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.125461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.125765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.126086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.127573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=62fe38a03ef04a2baa5ec228d6a8cf97) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:39.127929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.129638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.137481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 271/533] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:38 2022] GET /identity/v3/role_assignments?user.id=62fe38a03ef04a2baa5ec228d6a8cf97&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:39.138310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:39.215059 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506fe5dc-9f1e-4baa-8231-b36fed59162e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:39.242576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:39.296538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.297124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.297406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.297680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.359406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:39.366079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3727e-21b9-41e9-8758-a4e18f837c67 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:39.409670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.411552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.413341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.413946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.415048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:39.415565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.417254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.421611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.423539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.460661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 272/534] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:39.466164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:39.547091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 263/535] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:39.548936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:39.562357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:39.665403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29108b-49eb-4cef-9d01-bb7de8659551 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:39.706501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.707306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.707528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e334c-38ed-4be0-b998-39908ae135f8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:39.707659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.708400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.721665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.725698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:39.745502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:39.746425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:39.747299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:39.747299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:39.747299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:39.747299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:39.751977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 264/536] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:39.753362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:39.802009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.803140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.803631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.804183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.805223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=a711191915364aa7b4436dfbb9844c0a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:39.805761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.807647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.823190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 273/537] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:39 2022] GET /identity/v3/role_assignments?user.id=a711191915364aa7b4436dfbb9844c0a&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:39.840264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:39.868562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954e06-7320-417a-98e7-e1d4e1e29ed0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:39.905909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:39.906652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:39.906944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:39.907226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:39.908004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:39.908754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:39.910375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:39.929288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 265/538] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:39.931358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:39.983139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:40.089677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c13e2-3f0b-48d6-9375-78c0be075db5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:40.131591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:40.132431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.132715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.132994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.140572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:40.142033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-35cbb3d2-b252-457a-ba00-b65cf243e149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:40.163638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:40.164590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:40.165446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:40.169452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 274/539] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:40.175362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:40.207606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccccd5a-25dd-424b-959c-8edf6862ae61 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.208460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccccd5a-25dd-424b-959c-8edf6862ae61 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.208745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccccd5a-25dd-424b-959c-8edf6862ae61 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.210318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 275/540] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:40.218427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.218776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.219063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.237045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:40.238234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:40.378989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312869f-306a-4b63-a43f-3e08845c24cd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:40.405557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 276/541] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:40.407012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:40.418342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:40.419296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.419789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.420304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.421306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:40.421817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:40.423895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:40.437499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 266/542] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:40.444030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:40.444171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:40.492167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:40.554484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051c38e-b0b3-4df6-b817-f740e1a65dc6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:40.591855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:40.593032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.593518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.593997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.605986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:40.614206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:40.615116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:40.615949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:40.618598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 267/543] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:40.624368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:40.690906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:40.708216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c91e4-2dc7-4cfe-b20a-e360adf6896c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:40.732045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dbe77-56e1-4571-b02a-3a02e2724678 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:40.768376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:40.769356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.769900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.770389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.771561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:40.772112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:40.773762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:40.783148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 268/544] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:40.789667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:40.833159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:40.833806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.834090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.834361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.835422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=dcb8facb574a4935aa7fb390397c1cbb) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:40.835530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:40.836942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:40.861984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 277/545] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:40 2022] GET /identity/v3/role_assignments?user.id=dcb8facb574a4935aa7fb390397c1cbb&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:40.901549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b12b-9aa2-47cd-947a-75c19ed8315d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:40.912457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:40.939716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:40.940867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:40.941392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:40.941952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:40.954993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:40.956774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bf997152-a4aa-4db3-8d1d-6d6954f6dd04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:40.976165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:40.977106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:40.977951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:40.977951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:40.977951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:40.977951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:40.984061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 269/546] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:40.985921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.070915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce0a3-baab-49e8-89c8-1d7ea1797dbf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.071242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce0a3-baab-49e8-89c8-1d7ea1797dbf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.071482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce0a3-baab-49e8-89c8-1d7ea1797dbf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.073431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 270/547] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:41.091403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.091726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.092279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.117538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:41.118756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:41.123010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:41.150590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9c0d1-db6d-4f3b-bc08-efcbb54f0d72 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:41.191753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:41.192502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.192788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.193065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.193795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:41.194103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:41.195574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:41.210630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 278/548] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:41.215955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.283718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 271/549] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:41.319149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.330319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468530e-37fc-4e4e-b7e8-e6df67b8d3c2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:41.369549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:41.370502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.370784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.371066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.374335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:41.380601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:41.383518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:41.398396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:41.399338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:41.400297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:41.404836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 279/550] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:41.406739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.529640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501aa34-0ade-4e17-9e97-4992b52fd02a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:41.573800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:41.591142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e28d9-6efc-4eb2-954b-15a2ab99f013 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:41.594482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:41.595152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.595432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.595706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.596564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:41.596866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:41.598793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:41.621982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 280/551] 10.222.0.44 () {56 vars in 1135 bytes} [Tue May 24 09:55:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:41.632792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.654203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:41.655010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.655290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.655569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.679750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:41.687759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:41.688796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:41.689710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:41.690856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 272/552] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:41.704200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.753762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:41.846477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec42aee-143d-4b6c-b19d-a55880e93e6d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:41.888175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853f0e-0ee9-4e45-bcd3-39e1c6846236 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:41.904722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511a58a-e1ff-466c-b988-155f179ed273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:41.905379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511a58a-e1ff-466c-b988-155f179ed273 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.905662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511a58a-e1ff-466c-b988-155f179ed273 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.906055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511a58a-e1ff-466c-b988-155f179ed273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.931572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:41.932864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.933604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.934510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.935745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:41.936573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:41.938894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030c742-5d15-44d1-a39a-5f94b63dd409 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:41.950885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 273/553] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:41.952922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789cd46-048f-4700-b346-d1d917399457 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:41.953831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789cd46-048f-4700-b346-d1d917399457 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:41.954677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789cd46-048f-4700-b346-d1d917399457 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:41.956444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 274/554] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:41.958362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789cd46-048f-4700-b346-d1d917399457 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:41.976096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:41.983239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511a58a-e1ff-466c-b988-155f179ed273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:41.984882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511a58a-e1ff-466c-b988-155f179ed273 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.044563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.094187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 281/555] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:42.095791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.096236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.096647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.112805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789cd46-048f-4700-b346-d1d917399457 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.115534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:42.117055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:42.157933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.158763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.159050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.159329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.179009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.180529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.196652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 282/556] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:42.198238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:42.204801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:42.205766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:42.207085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:42.207085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:42.207085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:42.207085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:42.207085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 275/557] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:42.212179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.283958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.315057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.337028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb475d-ad58-41f2-b4b1-bd3bf392eaa0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.341100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5228e-16e5-42f6-886c-4a890c5c458f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.376252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.377411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.377520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.378135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.378242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.378538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.379212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.380462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.381830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:42.382364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.384143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.391313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.392808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.398119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 276/558] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:42.399165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:42.412636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:42.414393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:42.415304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:42.415304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:42.415304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:42.415304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:42.418367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 283/559] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:42.419234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.519508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6398c-4ba2-4b98-b8eb-a600f16317b2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.540969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8284-9ab8-44c4-99bb-45fe61a47851 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.543946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.560443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.561569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.562135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.562615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.575835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:42.578314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.579104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.579390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.579671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.583249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:42.588012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:42.589269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:42.590155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:42.590805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.590805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.593423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 277/560] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:42.594453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:42.610629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:42.611674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:42.612672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 284/561] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:42.613375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.708232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b409-ec58-4c30-8729-f2a9487a1cba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.720153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69fd96-8922-4f6e-8dd5-6ee966e98cfc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.746286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.747055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.747338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.747613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.748364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:42.748665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.750273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.754455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.755666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.755985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.756264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.757009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:42.757318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.758705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73317-768b-406f-a03e-cafb9a09ff10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.767706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 278/562] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:42.767706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.775838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 285/563] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:42.775838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ecaa9-7a34-4b4c-a52e-5d6b87843025 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.775838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ecaa9-7a34-4b4c-a52e-5d6b87843025 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.775838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ecaa9-7a34-4b4c-a52e-5d6b87843025 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.776309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 286/564] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:42.777511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ecaa9-7a34-4b4c-a52e-5d6b87843025 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:42.809527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.842524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:42.869107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa95428-36bd-4b2d-9cd1-a3df3de28406 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.888771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ecaa9-7a34-4b4c-a52e-5d6b87843025 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:42.908270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.908951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.909234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.909514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.910349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:42.910659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.912777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ff215-8537-4ef6-a46c-343f6bff3dab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.924067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:42.925094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.925580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.926034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.930628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 279/565] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:42.931933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:42.932230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:42.932510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:42.936410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:42.938107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:42.949598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:42.950800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:42.953524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:42.954399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:42.955310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 287/566] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:42.955821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.024134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 280/567] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:43.025404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.056983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.065737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ad651-a7f1-4c14-beff-01d10ea90e54 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.085662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.105421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.106249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.106536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.106825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.122090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.123588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.142448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908120-4cf8-42c0-8e88-75190c007f41 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:43.142762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:43.143632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:43.146149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:43.146149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:43.146149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:43.146149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:43.146149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 288/568] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:43.146149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.185497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.186294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.186578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.186861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.199280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.200773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:43.220553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:43.221499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:43.222392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:43.222392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:43.222392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:43.222392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:43.222392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 281/569] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:43.222666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.262354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870fa15-58ab-4e26-a00e-6c87efa29d8f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.297661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.298322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.298602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.298877 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.299649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:43.299985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.301998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.310164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.313815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 289/570] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:43.314616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.329448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b50774-1a45-4262-9cd4-b4db62b19cf6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.345052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.365606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.366410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.366691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.366968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.377006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:43.384907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:43.386054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:43.387012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 282/571] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:43.387732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.415929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50de1c-ee23-4719-a708-ad3ad9980796 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.452749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.453406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.453688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.453959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.454667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:43.454969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.456371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5ab21-3fd5-470c-bfd3-c55efc6eb04a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.468003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 290/572] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:43.469226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97744b0-8193-4197-a48a-5103443c7cd9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.469511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97744b0-8193-4197-a48a-5103443c7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.470043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97744b0-8193-4197-a48a-5103443c7cd9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.471996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 291/573] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:43.472969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97744b0-8193-4197-a48a-5103443c7cd9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.494927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676caa-69fd-4d00-b264-e200e4de6c0a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.528431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.529088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.529373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.529653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.530374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:43.530682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.532088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.541374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.544736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 283/574] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:43.545672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.564741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.575156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97744b0-8193-4197-a48a-5103443c7cd9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.609060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.609702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.609992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.610265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.611079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=e7af6dbe9ff8421f80acf0405be3088c) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:43.611390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.612869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.618358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 292/575] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/role_assignments?user.id=e7af6dbe9ff8421f80acf0405be3088c&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:43.619186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.659490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be445d-52cb-4b50-86eb-282d95858510 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.702684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.703751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.704075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.704348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.705260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:43.705563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.707069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e57b49-e249-4a30-a404-2d95b2ebd65b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.722246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 284/576] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:43.722246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.722246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.722246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.733534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ec642-9433-418b-8763-ecc9850a6cf2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.738500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:43.740260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:43.769824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.771725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.772050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.772327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.781730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.783298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:43.799712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:43.800760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 293/577] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:43.802024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.805135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.823521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 285/578] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:43.823521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:43.825256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:43.916162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ecba7-7b3c-422e-a83b-996f32960a08 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.930413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8f882-21f8-4855-9253-4ee2c132cd61 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:43.955029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.955847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.956135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.956424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.963399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.964880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.966216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:43.967005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:43.967294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:43.967563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:43.978719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:43.979676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:43.980694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:43.981636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:43.982075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:43.982154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 294/579] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:43.982154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:44.002831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:44.003835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:44.005268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:44.005268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:44.005268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:44.005268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:44.005268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 286/580] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:44.005985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.056124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.066839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.091422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b38a7-544e-41ba-b5c7-22d99af56928 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.122637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb2cf-17b1-4b36-9c9e-f2f50ecebfa1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.128470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.129381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.130514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.131022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.132060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:44.132744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.134429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.153991 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 295/581] 10.222.0.44 () {56 vars in 1137 bytes} [Tue May 24 09:55:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:44.154892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.162852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.163979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.164454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.164927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.175812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:44.184442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:44.185392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:44.186230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 287/582] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:44.187630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.308939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0596ec-de51-4311-bd20-ae7c71812da4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.309952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e90c-e205-4378-8746-180b98bd7fee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.311268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.344560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.345645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.346321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.346938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.347212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.347965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:44.348274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.349739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.349973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.350400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.350688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.350967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.351777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:44.352135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.356406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.362260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 288/583] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:44.362967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.370291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 296/584] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:44.371140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.488650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47693d7-ae59-4efb-8305-0286e91704e7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.490072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64544931-cb8c-49b3-92f8-60e90dc5c60d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.525188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.525705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.525983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.526272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.526367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.526551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.526646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.526905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.527679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:44.528019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.529406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.537995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.538292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 297/585] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:44.539092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.539983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:44.561541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:44.562484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:44.563382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:44.563382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:44.563382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:44.563382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:44.563382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 289/586] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:44.563672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.588051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.605805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.652095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8a448-e857-4bbc-bf1a-d1c6bc5f09b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.679296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d986a-371d-4dbd-ba7c-6abb0391fc2d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.688306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.689106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.689393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.689675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.698978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.700490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:44.716103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:44.717123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:44.718067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 298/587] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:44.719407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.726484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.727397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.727686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.728001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6dc6411c631a41d5a22ee51adca2b8f1/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.744615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=6dc6411c631a41d5a22ee51adca2b8f1, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.746501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.829623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 290/588] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:44 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6dc6411c631a41d5a22ee51adca2b8f1/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:44.829623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.839397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b885c-09b3-4022-96c6-677cde0e2dda None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.864782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.895847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.896968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.897257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.897536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.899374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:44.913496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.916628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:44.940474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938bdc1-4290-4237-a84f-31934031555f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:44.940808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:44.941668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:44.943170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:44.943170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:44.943170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:44.943170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:44.943170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 299/589] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:44.944690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:44.989808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:44.991253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:44.991546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:44.991853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:44.993176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:44.993497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:44.995291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.011390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 291/590] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:45.012664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.062419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0513-5d90-45ad-a543-f1abc2802fc9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.115570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.116613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.117116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.117612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.119346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:45.119966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.122368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.131352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0f789-024f-46fc-a009-d8f7bdc3bb19 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.150000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 300/591] 10.222.0.44 () {56 vars in 1137 bytes} [Tue May 24 09:55:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:45.150000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.166287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:45.175173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.178776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.178776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.178776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.178776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:45.178776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.179950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.184239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:45.197262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 292/592] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:45.197262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.278389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfaeb1-c20e-4a69-8b38-0e33a450134e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.314207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77301f1b-4138-477f-bd52-520f7b48fdd8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.317771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.318722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.319073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.319416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.327301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.328973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:45.345742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:45.346888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:45.347879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:45.349391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 301/593] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:45.349391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.354039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.354039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.354039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.354039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.365041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.366751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:45.386425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:45.388274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:45.390469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:45.390469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:45.390469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:45.390469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:45.390469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 293/594] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:45.390469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.438654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:45.451492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:45.468267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c7ed3-de7e-40dd-8213-eb1d9deb8234 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.504604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.505457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.505746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.506165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.511204 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095e936-0882-4fcb-bd4f-316afc414e9c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.514928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.516414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:45.531749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:45.532746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:55:45.533893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:45.538155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 302/595] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:45.539019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.552271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.553251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.553742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.554172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.555279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:45.555729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.557422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.575880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 294/596] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:45.577117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.647443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8748f-a5ae-4685-985d-b08ff84d6df6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.686122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:45.689815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.690495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.690782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.691064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.691790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:45.692378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.692860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0156b-33a9-4af9-ba43-4f89b6c7b830 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.693988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.710861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 303/597] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:45.716769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.721837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:45.740408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.741080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.741422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.741781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.742577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:45.742884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.744349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.767635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 295/598] 10.222.0.44 () {56 vars in 1139 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:45.767635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.853888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb834a-17d0-4512-947c-6ff35aad26c1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.886202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d072c6-a97b-487a-8129-2451043eb2db None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:45.888585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85877a-a7ac-4082-ad7c-5d22338f46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.889473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85877a-a7ac-4082-ad7c-5d22338f46d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.889758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85877a-a7ac-4082-ad7c-5d22338f46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.890036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85877a-a7ac-4082-ad7c-5d22338f46d6 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/62fe38a03ef04a2baa5ec228d6a8cf97/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.904219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85877a-a7ac-4082-ad7c-5d22338f46d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=62fe38a03ef04a2baa5ec228d6a8cf97, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.905609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85877a-a7ac-4082-ad7c-5d22338f46d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.925154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:45.925950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.926259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.927114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.933961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:45.935399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:45.949726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:45.950613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:45.951509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:45.955421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 296/599] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:45.956207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.968369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 304/600] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:45 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/62fe38a03ef04a2baa5ec228d6a8cf97/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:45.970188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0392a-816a-4e1f-a701-f21fda809503 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:45.970488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0392a-816a-4e1f-a701-f21fda809503 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:45.970755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0392a-816a-4e1f-a701-f21fda809503 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:45.975842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 305/601] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:45.975842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0392a-816a-4e1f-a701-f21fda809503 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:45.985195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:46.045342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:46.087876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b75e0a-cae9-4861-a682-4975248b238a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.108349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0392a-816a-4e1f-a701-f21fda809503 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.132268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.133576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.133858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.134135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.148887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:46.150532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:46.153910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.154706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.154933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.155214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.156139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:46.156458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:46.158743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9486f7d0-c4c7-467a-bdda-ada8240a4a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:46.172571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:46.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:46.176590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:46.176590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:46.176590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:46.176590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:46.176590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 297/602] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:46.177322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 306/603] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:46.177397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.177397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.177397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.183720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:46.203232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:46.205380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:46.292709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:46.305146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 298/604] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:46.306074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:46.306593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fc4e9-2e80-4cf2-829e-ea5988b4b1e9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.322225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:46.348797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.349695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.349980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.350259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/a711191915364aa7b4436dfbb9844c0a/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.366249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=a711191915364aa7b4436dfbb9844c0a, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:46.367729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:46.415905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b8f8b-0aed-418c-b8e9-1a8d89a80c90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.450374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 307/605] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:46 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/a711191915364aa7b4436dfbb9844c0a/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:46.450972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:46.490201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.491137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.491432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.491713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.495256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:46.495577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:46.499580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:46.529115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 299/606] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:46.535217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:46.650061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:46.681482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f6d1c-e5da-48f1-94c1-9ef7f5dfcf5a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.683349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae547b51-fdf5-4867-ae49-790ce66368e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.726702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.727250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.727537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.727641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.727846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.727947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.728772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.728874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.737592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:46.740067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:46.740183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:46.748075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:46.749050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:46.750198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 308/607] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:46.755742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:46.757777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:46.759901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 300/608] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:46.768256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:46.769468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:46.821339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:46.909471 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e2e6b-04c9-4a2e-9562-b44e11835bd5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:46.948548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:46.949391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:46.949687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:46.949967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:46.950724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:46.951038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:46.953093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:46.962360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 309/609] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:46.968570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.066897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196fddc-3744-41ad-b635-180b0a157481 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:47.100187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:47.112195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:47.125203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb5c4c-2392-4119-84bc-550f04488c56 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:47.142637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:47.143315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.143600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.143897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.144687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:47.145790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:47.147252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:47.171427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 301/610] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:47.177541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.194380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:47.195245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.195711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.200310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.221028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:47.222653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:47.254132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:47.255462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:47.256519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:47.256519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:47.256519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:47.256519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:47.262038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 310/611] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:47.264734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.347167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206f507-a30d-48b3-930a-6b6e3d9362a0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:47.389892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d1f9a-922c-4f08-94de-91119f7ee5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:47.390793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1f9a-922c-4f08-94de-91119f7ee5d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.391075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1f9a-922c-4f08-94de-91119f7ee5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.391347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1f9a-922c-4f08-94de-91119f7ee5d7 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/dcb8facb574a4935aa7fb390397c1cbb/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.399741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48762f5-3e4f-41e2-8baf-4c5da6bb782e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:47.411385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d1f9a-922c-4f08-94de-91119f7ee5d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=dcb8facb574a4935aa7fb390397c1cbb, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:47.414738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d1f9a-922c-4f08-94de-91119f7ee5d7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:47.446896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:47.448462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.448956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.449497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.450510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:47.451043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:47.452685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cef08e-18ac-43f7-beab-94db4525775b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:47.461418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:47.467583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 311/612] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:47.469058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9994ed-e6a5-4047-827c-607e2a01cb73 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.469569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9994ed-e6a5-4047-827c-607e2a01cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.470124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9994ed-e6a5-4047-827c-607e2a01cb73 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.476272 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 312/613] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:47.476272 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9994ed-e6a5-4047-827c-607e2a01cb73 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.499748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 302/614] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:47 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/dcb8facb574a4935aa7fb390397c1cbb/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:55:47.502185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.502465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.502744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.543972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:47.546269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:47.611591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:47.651075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9994ed-e6a5-4047-827c-607e2a01cb73 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:47.697178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:47.698440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.698564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.698736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.711052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:47.712892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:47.719852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 303/615] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:47.734456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:47.735749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:47.736833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 313/616] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:47.742157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.755266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.863694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adf145-f2bf-4126-8874-a3b759cb6aed None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:47.887453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:47.902297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:47.907956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:47.907956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:47.907956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:47.907956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:47.907956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:47.907956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:47.926846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 304/617] 10.222.0.44 () {56 vars in 1135 bytes} [Tue May 24 09:55:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:47.935411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:47.955476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:47.990472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf97d-a0e3-4541-aa36-2c8a9519af35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.042569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6302b-5811-4068-b490-30a0d09c8cb5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.075832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.076656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.076961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.077298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.080451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.081935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.082474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.083044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.101379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:48.102903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:48.103554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:48.110819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:48.111835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:48.112712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:48.120490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 314/618] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:48.125854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:48.126846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:48.127760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:48.128722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:48.128722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:48.128722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:48.128722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:48.131660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 305/619] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:48.136776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.279491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:48.306653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed98c3a-49da-445c-8707-a8482d45e318 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.312193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd29e-e704-45cc-8432-64abdf647692 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.351993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.352670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.352954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.353232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.354285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:48.354596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:48.356002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:48.358007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:48.369666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 306/620] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:48.375340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.417792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.418523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.418809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.419085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.419921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:48.420229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:48.421849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:48.454023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 315/621] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:48.464844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.556416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8b752-8ed8-41e1-a7b4-51a42570388b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.584808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:48.592787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.593557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.598720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.598720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.599290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad207ac3-1aee-48a6-9948-7d5c4d852787 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.602628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:48.603422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-682fde5f-b28a-40ea-afcc-a8cc78eaaa45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:48.617900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:48.619129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:48.620061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:48.623975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 307/622] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:48.625320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136fe42-b480-4a01-8469-6ba5d566381c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.625614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136fe42-b480-4a01-8469-6ba5d566381c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.625897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136fe42-b480-4a01-8469-6ba5d566381c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.627441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 308/623] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:48.628179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136fe42-b480-4a01-8469-6ba5d566381c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.642052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.643178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.643768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.644298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.657203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:48.659075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f0061e9a-694f-4a19-9cdf-eedcb1e5c1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:48.678715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:48.679677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:48.680620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:48.680620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:48.680620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:48.680620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:48.687318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 316/624] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:48.688934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.689423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.689893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.708708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:48.710686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:48.739355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:48.742104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136fe42-b480-4a01-8469-6ba5d566381c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.785561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.786773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.787053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.787340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:48.788412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:48.788719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:48.790866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:48.794586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 317/625] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:48.795726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.819705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 309/626] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:48.828488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:48.886481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:48.947125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d991985-cabb-49e7-b3d3-308330007077 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:48.986207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:48.987475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:48.988029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:48.988526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/e7af6dbe9ff8421f80acf0405be3088c/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.005243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=e7af6dbe9ff8421f80acf0405be3088c, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.007029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:49.055144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204230-beb5-4ca8-a53f-0e61bc1606af None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.059151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 310/627] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:55:48 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/e7af6dbe9ff8421f80acf0405be3088c/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:55:49.060196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.106745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.107605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.107915 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.108194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.108940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:49.109497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.111859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119695fa-672d-4c2a-83ce-fb30f7db5584 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:49.128770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 318/628] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:49.130318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12106ab-1f5c-4dbe-b221-ad85ad34458b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.130600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12106ab-1f5c-4dbe-b221-ad85ad34458b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.130879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12106ab-1f5c-4dbe-b221-ad85ad34458b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.135958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 319/629] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:49.137245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12106ab-1f5c-4dbe-b221-ad85ad34458b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.174145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:49.213143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:49.219196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bb257-e9b6-49e2-a034-29e1adc794f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.266496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3bc0f-5761-47a4-b8a1-2efd590a9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.267459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3bc0f-5761-47a4-b8a1-2efd590a9929 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.267874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3bc0f-5761-47a4-b8a1-2efd590a9929 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.268255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3bc0f-5761-47a4-b8a1-2efd590a9929 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.279183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3bc0f-5761-47a4-b8a1-2efd590a9929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:49.282414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12106ab-1f5c-4dbe-b221-ad85ad34458b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-02b3bc0f-5761-47a4-b8a1-2efd590a9929 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:49.288368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:49.289553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:49.290685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:49.294166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 311/630] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:49.295453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.295741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.296048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.316035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:49.317572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:49.328607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.329533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.329806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.330080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.338729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.340347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:49.356905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:49.357892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:49.358912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:49.362764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 320/631] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:49.363775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.404972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 312/632] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:49.410363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.471430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:49.496510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a655c-d3b6-4055-81ee-91f41d97ca5a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.531984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:49.545317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c8ba-97c0-4d75-ba81-c4f28c4888dd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.549325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.550316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.550785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.551854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.552958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:49.553448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.555513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:49.573611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 321/633] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:49.574606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.586198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.587195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.588175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.588636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.590218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:49.590833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.592762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:49.618589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 313/634] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:49.619696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.699040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686bb64-1a52-407a-abb4-da8d62116a19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.735275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.736106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.736392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.736725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.745725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdb094-0e70-4f05-b824-7a6856b70202 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.748645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:49.757805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:49.758869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:49.759746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 322/635] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:49.760502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.765868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:49.797467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.799852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.800290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.800744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.813907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.815869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:49.826069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:49.841624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:49.843537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:49.844712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:49.844712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:49.844712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:49.844712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:49.846086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 314/636] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:49.847527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:49.874396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7614d-f78a-47dd-b26a-a8f75b56402a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.914616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c22e6-e8c9-482e-9828-262b8770ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:49.916162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c22e6-e8c9-482e-9828-262b8770ca72 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:49.916622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c22e6-e8c9-482e-9828-262b8770ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:49.917052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c22e6-e8c9-482e-9828-262b8770ca72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:49.966618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348415-e72d-4881-bac3-3aa65a69caaf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:49.998426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c22e6-e8c9-482e-9828-262b8770ca72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:49.999924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c22e6-e8c9-482e-9828-262b8770ca72 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.002568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.003245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.003357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.003530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.003829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.004653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:50.004962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.006331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.015942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 315/637] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:50.017706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.079980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.105925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 323/638] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:50.107538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba15b6-0d25-4e3b-b1d6-5dc2c615409a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.107839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba15b6-0d25-4e3b-b1d6-5dc2c615409a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.108114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba15b6-0d25-4e3b-b1d6-5dc2c615409a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.109592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 324/639] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:50.110096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba15b6-0d25-4e3b-b1d6-5dc2c615409a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.127845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12730e38-df45-4426-9c33-10b8a79491c5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.163127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.163790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.164108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.164386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.165099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:50.165408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.166794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.184783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 316/640] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:50.184783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.223015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba15b6-0d25-4e3b-b1d6-5dc2c615409a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.225482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.260506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.261329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.261612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.261890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.274407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.275894 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.290040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d58de-86d6-44e7-b1b8-004fd975f2de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-59bf274e-ee49-4206-a8b0-f5d3b5d3ddfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:50.294585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:50.295479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 325/641] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.301743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.315473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:50.316723 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:50.318759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.333977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.337447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.337447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.337447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.346044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.347492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:50.366383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:50.367380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:50.368342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:50.368342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:50.368342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:50.368342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:50.372133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 317/642] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:50.372964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.400350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 326/643] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:50.400350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.486667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500292b-2595-4f27-9d97-609f69f635f4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.506808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.522458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8cce-ed04-4001-930c-4dfdb8c8570a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.522840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.523632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.523957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.524215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.531436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.532897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:50.553487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:50.554438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:55:50.555480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:50.556700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 318/644] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:50.556700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.563116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.563777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.564086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.564357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.565069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:50.565370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.567330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.584069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 327/645] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:50.584069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.590957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.664601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263ea0-6321-4057-8278-5c324b9350da None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.689159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1589cf-4310-4009-a21b-d411eaf24a8b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.701866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.702542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.702830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.703108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.703853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:50.704165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.705531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.717475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 319/646] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:50.718283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.730668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.731821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.732300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.732570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.743709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:50.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:50.752651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:50.753523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 328/647] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:50.754471 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.764475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.822166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:50.832189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b41ef-dc10-484e-b696-3d145de92c51 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.858161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee2817-cce0-4792-b084-a2ba91315625 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:50.870277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684db9-8968-4006-a457-1eac08719901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.871166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684db9-8968-4006-a457-1eac08719901 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.871644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684db9-8968-4006-a457-1eac08719901 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.872147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81684db9-8968-4006-a457-1eac08719901 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.873277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81684db9-8968-4006-a457-1eac08719901 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:50.873734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81684db9-8968-4006-a457-1eac08719901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.875442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81684db9-8968-4006-a457-1eac08719901 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.894561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:50.895387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:50.895671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:50.895973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:50.897365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 320/648] 10.222.0.44 () {56 vars in 1137 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:50.898480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684db9-8968-4006-a457-1eac08719901 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.907845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:50.909349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:50.925611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:50.927494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 329/649] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:50.928644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:50.996822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.015938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81684db9-8968-4006-a457-1eac08719901 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.036175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56745-8bdf-47e9-96f3-09fe8be5d221 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.053999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.054793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.055081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.055355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.063254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.064723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.070658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.071332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.071621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.071930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.072943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:51.073251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.074622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:51.079908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:51.080951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 321/650] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:51.081900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.089511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 330/651] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:51.090347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.096149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.198140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19235-166d-4761-a571-9b9367b1343f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.201277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca009c3-8d66-4812-b661-19363cfc0280 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.230321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.235610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.236299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.236588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.236889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.237967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.238690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.238974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.239254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.240117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:51.240429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.241870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.264141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 331/652] 10.222.0.44 () {56 vars in 1137 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:51.264141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.317831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.319949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.333469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.360736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a9891-60cc-4225-b80b-f7f39e6bc4be None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.395522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.396433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.396721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.396999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.397780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:51.398089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.399521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.415774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 332/653] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:51.415774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.424137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 322/654] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:51.425076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.462479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.515074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb099b96-4b00-44e8-8512-7f34fe987d58 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.525790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53424ff-9d07-4e64-8601-f0ef2b44eed7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.537104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.547650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.550153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.550153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.550153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.559581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.559741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.560249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.560534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.560814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.561097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3ce56662-b86d-49b6-b737-97268e79ea5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:51.578295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:51.579246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:51.580237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:51.580237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:51.580237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:51.580237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:51.580237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 333/655] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:51.580712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4fe84-df46-4318-a996-4029d5839092 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.581024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4fe84-df46-4318-a996-4029d5839092 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.581223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4fe84-df46-4318-a996-4029d5839092 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.583084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 334/656] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:51.583938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4fe84-df46-4318-a996-4029d5839092 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.632871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.634320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.679001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.683423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4fe84-df46-4318-a996-4029d5839092 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.717581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.718178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.718464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.718745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.719566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6dc6411c631a41d5a22ee51adca2b8f1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:51.719908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.721409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.727934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 335/657] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/role_assignments?user.id=6dc6411c631a41d5a22ee51adca2b8f1&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:51.729121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.742235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 323/658] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:51.743129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.757555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:51.856625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfd818-4b27-4cfd-bab2-02b999b296b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.862540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678bbf1-9b4e-4043-a019-30bd47e76996 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:51.896153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.896969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.897307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.897529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.900500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:51.901171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.901451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.901724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.902453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:51.902756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.904207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f951f82-dcb3-4542-af6f-ae8249023658 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.910177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:51.912600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:51.917465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 324/659] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:51.918984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:51.919487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:51.919991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:51.936278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:51.937244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:51.938143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:51.938143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:51.938143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:51.938143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:51.938143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 336/660] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:51.938896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:51.941111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:51.943354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:51.956415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.020907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.025704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 325/661] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:52.026534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.061789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeca17-3661-4e7c-ac11-61b66a96172f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.097377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.098689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.098981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.099326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.109525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.110987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:52.130234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:52.131314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:52.132549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:52.132549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:52.132549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:52.132549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:52.132549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 337/662] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:52.132549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.139578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02452-d673-4845-b469-cc83ea3b2deb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.176098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.176907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.177187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.179508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.185439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.186942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:52.203195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:52.204388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 24 09:55:52.205920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:52.208838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.209135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 326/663] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:52.210004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.246633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef4be3-805f-4e6d-9a10-707f4f78eae5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.272695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.282335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.283004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.283287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.291829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.291829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:52.291829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.291829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.303149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 338/664] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:52.303149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.325312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64a320-1b64-401b-b2a7-2cc679e06609 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.364057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.364953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.365308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.365646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.376593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:52.384894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:52.386040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:52.386935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 327/665] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:52.387645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.411573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30e419-b0e2-4180-8be1-617a8a94abda None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.439364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.454063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.455324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.455617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.455927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.456818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:52.457132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.459994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.479043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 339/666] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:52.479043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.499584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c7df1-3468-4f52-af49-ecd19a017caf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.522592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.536650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.537337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.537708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.537988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.538824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:52.539136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.540618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.563681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 328/667] 10.222.0.44 () {56 vars in 1139 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:52.563681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.595299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77030c3d-a234-4427-bd11-e41d98b1e355 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.632030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.632820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.633104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.633386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.640351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.641814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:52.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:52.657595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:52.658529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 340/668] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:52.659025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.672591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872758-fd9e-4705-8563-6048351b4f5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.709444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.710137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.710428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.710572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.710742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.711834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:52.712157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.713527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.721567 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 329/669] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:52.722522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.768838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.773970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012452d7-a261-4de4-b171-9f73c3fc32f6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.810194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.811727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.812048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.812332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.819676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.821422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.830593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38aeb9-b69a-4fac-962e-62bc0b07da05 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:52.835928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:52.836822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 341/670] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:52.842707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:52.878310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.878964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.879299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.879691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.951320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0dc58-edcd-4bd7-9462-5ec4b71ddd5a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:52.954293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.955748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:52.960163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:52.987732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:52.988416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:52.989290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:52.989565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:52.990348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:52.990656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:52.992105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.000054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.005133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 342/671] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:53.010602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.070290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 330/672] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:53.070290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.125385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe187905-793d-4632-8b9a-f5ff90579101 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.161876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.163090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.163376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.163655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.174561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.174686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4538-777c-4326-abec-25a473118187 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.177772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:53.194179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:53.195220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:53.196206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:53.196206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:53.196206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:53.196206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:53.200303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 343/673] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:53.201143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.211704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.213137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.213137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.213137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.213916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:53.214042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.215493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.223283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.225077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.228928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 331/674] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:53.229610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.311605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cbb18-63b6-44eb-b784-ef204920b6ff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.333675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874da2b-3a02-477a-82fc-a2a5398a3c5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.349696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.350344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.350631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.350939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.351895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=62fe38a03ef04a2baa5ec228d6a8cf97) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:53.352084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.353514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.367825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 344/675] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/role_assignments?user.id=62fe38a03ef04a2baa5ec228d6a8cf97&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:53.367825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.378469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.379589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.379986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.380336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.395721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.397908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:53.418850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:53.420062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:53.421197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:53.421197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:53.421197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:53.421197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:53.425232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 332/676] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:53.426255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.487916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.498278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.514700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1fe8b-393e-40a8-a7eb-08fcdb1256e6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.555364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b1bdf-df7e-40ce-a85c-8325371451f0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.569641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.570305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.570586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.570858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.571595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:53.571953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.573611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.587246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 345/677] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:53.588082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.600334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.601616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.602102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.602826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.603884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=a711191915364aa7b4436dfbb9844c0a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:53.604485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.606450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.612791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 333/678] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/role_assignments?user.id=a711191915364aa7b4436dfbb9844c0a&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:53.614858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.738131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc59d3-d272-45bf-906c-475b8a70c995 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.738568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1953f1-6c31-42ac-bf3d-bcaf6353fe27 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.783825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.785924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.787595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.789431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.790287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:53.790803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.791776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:53.792824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:53.802802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.802802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.803017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:53.803017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:53.812275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:53.816450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:53.823102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 346/679] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:53.834378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.837810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:53.848677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:53.855493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 334/680] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:53.856519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:53.964642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b37e1-89ef-4ffb-8d67-b1b622966eae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:53.969461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd593f-610c-421f-8428-d442f1a3a5f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:54.002931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.003859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.004350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.004916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.006818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.007601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.008006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.008292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.009134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:54.009445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:54.010893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:54.012578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:54.014147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:54.030091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:54.032508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:54.035002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:54.036289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 335/681] 10.222.0.44 () {56 vars in 1135 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:54.036504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 347/682] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:54.036691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.045037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.087621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:54.134050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:54.171623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71904c89-a925-4dcb-9acd-adb336c97873 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:54.180901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1513fb-b5ad-4a47-b1d2-6b120e1db804 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:54.211313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.212236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.213121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.213423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.223745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.225199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.225713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.226211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.227818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:54.228626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:54.230652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108fe6-a79a-4a96-9ab2-88ccdfdcc653 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:54.251335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 348/683] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:54.251335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9986ca-7c28-4a0b-bbec-d06c763eedca None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.251335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9986ca-7c28-4a0b-bbec-d06c763eedca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.251335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9986ca-7c28-4a0b-bbec-d06c763eedca None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.251335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 349/684] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:54.260687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9986ca-7c28-4a0b-bbec-d06c763eedca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.298185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:54.299776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:54.337128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:54.391288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9986ca-7c28-4a0b-bbec-d06c763eedca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:54.420318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:54.437516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.438201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.438487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.438766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.439621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=dcb8facb574a4935aa7fb390397c1cbb) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:54.439975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:54.441659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dceada-1ee8-434d-a987-2ddb6652dd81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:54.464292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 350/685] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/role_assignments?user.id=dcb8facb574a4935aa7fb390397c1cbb&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:54.465895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.466185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.466468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.501120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:54.502552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:54.596181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 336/686] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:54.601987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.651004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 351/687] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:54.674452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.763838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c6458-5df5-4716-9892-e328bde447cb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:54.797801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ebb6f-e0c9-46f1-8be5-b51676935074 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:54.802997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.803876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.804217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.804493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.806650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:54.816188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:54.818764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:54.820503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:54.841177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:54.842120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:54.843036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:54.843036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:54.843036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:54.843036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:54.843036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 337/688] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:54.845486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:54.846374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:54.846657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:54.846930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:54.851207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.869359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:54.881198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:54.882166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:54.883030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:54.885767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 352/689] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:54.891428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:54.977655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c654-baf7-4a5a-b849-f4fd6ef6d292 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.016768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.017899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.018116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.018493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.019374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:55.019945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.021679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.025708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bf89-7c4f-49cd-b429-3bac96447db1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.039904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 338/690] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:55.042478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:55.068936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.069702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.069988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.070265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.071009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:55.071313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.073569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.086522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 353/691] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:55.093791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:55.107818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:55.173389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8bc81-d856-4c01-8b16-b8c22e2f1072 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.181809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:55.217956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.219056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.219494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.220447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.229667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.231682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:55.250045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:55.251100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:55.252447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:55.255755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 339/692] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:55.262448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:55.345925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33b996-7644-4cd0-9a14-513320742704 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.383682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296128c0-7ac5-48fd-94f9-e9aaf89b4e10 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.392305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:55.427501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.428504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.428994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.429564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.433548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:55.434080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.435717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.436319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.437132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.437418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.437696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.460444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 340/693] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:55.466803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:55.476704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.478190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:55.515913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:55.516878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:55.517802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:55.517802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:55.517802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:55.517802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:55.524243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 354/694] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:55.529394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:55.581120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d70219-a40c-451a-9f1f-196c6fdff2b9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.619884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.620885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.621359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.621820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.622935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=e7af6dbe9ff8421f80acf0405be3088c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:55.623435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.625084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.633056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 341/695] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:55 2022] GET /identity/v3/role_assignments?user.id=e7af6dbe9ff8421f80acf0405be3088c&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:55.719106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:55.730162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fe454-5cff-4357-8eb1-5ee03a390c10 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.768956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.769558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.770545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.770830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.771661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:55.771993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.773400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.787193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 355/696] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:55.792434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:55.849052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:55.921936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572ff7-be64-41d6-9263-63408aa007b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:55.962426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:55.963559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:55.964031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:55.964471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:55.973360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:55.975100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e991c435-fad1-4ef3-92a9-146506d2af2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:55.990787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:55.995008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:55:55.996256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:55.998647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 342/697] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:55:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:56.008976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.123211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec770a5b-ee64-4bdb-8d50-a271b7f36f77 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:56.162428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cc69-04ec-42a1-82c8-5d21dfdf3a78 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.162731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cc69-04ec-42a1-82c8-5d21dfdf3a78 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.163134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cc69-04ec-42a1-82c8-5d21dfdf3a78 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.164854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 343/698] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:55:56.169011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:56.169925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.170391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.170497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.170870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.171214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.171329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.172408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:56.172903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:56.174626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:56.194599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:56.196065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:56.197120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 356/699] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:56.202459 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.217414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:56.285330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 344/700] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:56.311930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.343289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:56.406846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb351e0-b20e-45ea-ae19-3e425bb62af8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:56.453717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c9f95-3634-40fa-a363-822087fdf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:56.454384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c9f95-3634-40fa-a363-822087fdf8ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.454668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c9f95-3634-40fa-a363-822087fdf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.454941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c9f95-3634-40fa-a363-822087fdf8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.473666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d710fc-23fd-49f9-b2a6-679263189efb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:56.523765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:56.524989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.525283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.525561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.526249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:56.528298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0049d19f-b28b-45ee-af81-7970b7d7d2cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:56.546183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:56.547262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:56.548564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 345/701] 10.222.0.44 () {56 vars in 1129 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:56.552000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0959dc-6913-4338-9e3f-4f4daf0bc13a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.552000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0959dc-6913-4338-9e3f-4f4daf0bc13a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.552000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0959dc-6913-4338-9e3f-4f4daf0bc13a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.554033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 346/702] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:56.554033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0959dc-6913-4338-9e3f-4f4daf0bc13a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.555901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c9f95-3634-40fa-a363-822087fdf8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:56.558522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c9f95-3634-40fa-a363-822087fdf8ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:56.572171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:56.646757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:56.664310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0959dc-6913-4338-9e3f-4f4daf0bc13a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:56.701063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 357/703] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 24 09:55:56.702572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.702869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.703150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.706638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:56.707450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.707859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.708233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.709026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:56.709409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:56.710783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:56.719839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 347/704] 10.222.0.44 () {56 vars in 1124 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:56.719839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.727485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:56.728897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:56.801522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 358/705] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:56.802698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.846749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:56.857662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b8411-4ed6-4493-820e-0d2c6da419a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:56.905262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:56.906333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.906630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.906909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.914842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bfb9a-7b9d-4e41-ac60-5e5527e77504 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:56.921189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:56.922644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:56.935086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:56.948641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:56.949621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:56.950554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:56.950554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:56.950554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:56.950554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:56.950554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 348/706] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:56.951274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:56.964512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:56.965236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:56.965524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:56.965852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:56.966569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:56.966903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:56.969461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:56.983991 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 359/707] 10.222.0.44 () {56 vars in 1124 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:56.985325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.171469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026864b-578c-494a-ae4d-6d01271f36db None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.171469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:57.183769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbcb9d-2e07-4599-948d-66eaa6a7e52c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.246169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:57.246857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.247142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.247421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.248176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:57.248562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:57.249946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:57.250074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:57.250810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.251099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.251379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.267129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:57.268615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:57.270810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 360/708] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:57.276355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-759e90bc-ae11-4281-805a-deb427282a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:57.292812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:57.293774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:57.294688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:57.294688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:57.294688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:57.294688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:57.295884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 349/709] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:57.297414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20edac-a80e-49c3-b7bd-ad0a67cf4f55 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.298021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20edac-a80e-49c3-b7bd-ad0a67cf4f55 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.298503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20edac-a80e-49c3-b7bd-ad0a67cf4f55 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.300495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 350/710] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:57.301493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20edac-a80e-49c3-b7bd-ad0a67cf4f55 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.368187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:57.403663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd34a4-ecad-44bd-b90d-94e5c2646f89 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.422432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20edac-a80e-49c3-b7bd-ad0a67cf4f55 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.451233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:57.452914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.453413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.454021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.463080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:57.463607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:57.463791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.464057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.464332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.465045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:57.465349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:57.466331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:57.466697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d74f2-6506-40a9-8504-184cbc3bafb1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:55:57.484487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:57.485447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:55:57.486381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:57.486811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 351/711] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:57.486811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4aec-d193-4d00-bce8-143263531abb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.486949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4aec-d193-4d00-bce8-143263531abb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.487525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c4aec-d193-4d00-bce8-143263531abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.490229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 361/712] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:55:57.491213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.509448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-231c4aec-d193-4d00-bce8-143263531abb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:57.510911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-231c4aec-d193-4d00-bce8-143263531abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:57.524391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:57.603885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 352/713] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:55:57.605100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c4aec-d193-4d00-bce8-143263531abb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.628348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a843f2-46f8-498d-a5e9-633e3e39296a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.664706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:57.677552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:57.678157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.678441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.678716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.679583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:57.681667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:57.729937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c4aec-d193-4d00-bce8-143263531abb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.766694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:57.767826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:57.768371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:57.768854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:57.770479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:57.771184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:57.772320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 362/714] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:55:57 2022] POST /identity/v3/users => generated 254 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:55:57.776243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:57.776385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.801760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 353/715] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:55:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:57.809927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:57.925878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:57.977939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f09e3-07b8-4b97-9094-bc0ebb3a7798 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.986224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b023-b39b-4f58-9896-e1d4144a9213 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:57.989865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:58.025049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:58.026768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.027292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.028072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.029881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6dc6411c631a41d5a22ee51adca2b8f1) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:58.030408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:58.032073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:58.033414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:58.034269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.034576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.034811 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] PATH_INFO: `/v3/services/network` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.036119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:58.038181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:58.041005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 354/716] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:55:57 2022] GET /identity/v3/role_assignments?user.id=6dc6411c631a41d5a22ee51adca2b8f1&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:58.056070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:58.057152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:55:58.057996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:55:58.061086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 363/717] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:55:57 2022] GET /identity/v3/services/network => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:58.064030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:58.180786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb2bb-1378-4dcb-ad5a-5a07c5a041ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:58.220791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:58.222340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.223445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.224230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.225219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:58.225753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:58.227435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a9b03-5c4a-445a-ad24-40fed7c1881f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:58.233805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 355/718] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:55:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:58.239692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:58.357544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83cd7c-e298-44de-a83d-2fe1071fc3eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:58.409834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:58.411419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.411950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.412453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.413379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:58.413904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:58.415519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadac57e-5fb5-4f6e-b710-8ad8e50ae33e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:58.423624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 364/719] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:55:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:55:58.546706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aba1b-8589-4c89-826e-79e8b929db72 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.547335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aba1b-8589-4c89-826e-79e8b929db72 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.547852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5aba1b-8589-4c89-826e-79e8b929db72 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.549485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 356/720] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:58.560078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.560379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.560633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.585046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:58.592886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:58.594167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:58.678071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 365/721] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:58.701521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5aba1b-8589-4c89-826e-79e8b929db72 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:58.736335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:58.828641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5aba1b-8589-4c89-826e-79e8b929db72 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:58.866290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:58.867451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:58.867980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:58.868464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:58.880823 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:55:58.889245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:58.890210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:55:58.891072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:58.893969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 357/722] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:58.899514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:59.036239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47b2a8-4e7b-48bf-ba71-be69b53dfa6d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:59.086939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:59.087527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:59.087822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:59.088107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:59.088857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:59.089160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:59.090536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:59.096859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:59.104197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 366/723] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:55:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:59.109265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:59.230835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:59.242739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ad9cd-af0a-472b-8068-3ebb66452279 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:59.279255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:59.280446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:59.281011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:59.281723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:59.293335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:59.295061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:55:59.315089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:59.316121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:59.317114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:55:59.317114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:55:59.317114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:55:59.317114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:59.319172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 358/724] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:59.324606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:59.462969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e856-2fed-4c43-92ab-2546dacf3df2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:59.510232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:59.510897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:59.511178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:59.511455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:59.512221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:55:59.512530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:59.513959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c1fa4-cab4-4cf7-a893-1d6496dea551 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:59.527596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 367/725] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:55:59.532796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:59.675371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6ecc1-cd49-41b3-bcbb-90cf442141a1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:55:59.680954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217dd9-179f-4179-b152-2e1486066c7f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:59.681247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217dd9-179f-4179-b152-2e1486066c7f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:59.681531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217dd9-179f-4179-b152-2e1486066c7f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:59.683140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 368/726] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:55:59.688019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:59.688308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:59.688591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:59.705839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:55:59.707329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:55:59.735944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:55:59.736746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:55:59.737030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:55:59.737310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:55:59.750650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:55:59.753451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:55:59.783253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:55:59.784363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:55:59.786426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 359/727] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:55:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:55:59.792713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:59.800187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:59.813551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:55:59.840179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 369/728] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:55:59.927623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:55:59.963906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851857d-c24a-4060-a879-be45bf3d05b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:00.044592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:00.045274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.045561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.045845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.046697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:00.047009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:00.048483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:00.069225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 360/729] 10.222.0.44 () {56 vars in 1135 bytes} [Tue May 24 09:55:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:00.076382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:00.146944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ce228-ad4b-40fa-bd94-0538262fa625 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:00.184232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:00.219377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:00.219997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.220283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.220562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.221300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:00.223214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:00.228217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74beceb-3ad9-44b9-b561-7b150717fb98 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:00.306274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e580-70af-4e8c-92cc-9a65ade40ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:00.307036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e580-70af-4e8c-92cc-9a65ade40ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.307229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e580-70af-4e8c-92cc-9a65ade40ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.307505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e580-70af-4e8c-92cc-9a65ade40ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.345837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 370/730] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:55:59 2022] POST /identity/v3/services => generated 251 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:00.401138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e580-70af-4e8c-92cc-9a65ade40ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:00.402701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e580-70af-4e8c-92cc-9a65ade40ef0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:00.472514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:00.524282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 361/731] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 24 09:56:00.532973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:00.548299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c28a-bcd2-47dd-be40-9929366db8a6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.548674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c28a-bcd2-47dd-be40-9929366db8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.548957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c28a-bcd2-47dd-be40-9929366db8a6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.551066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 362/732] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:00.558901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca47d-59b4-44a8-a06d-6b8325c36ecb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.559239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca47d-59b4-44a8-a06d-6b8325c36ecb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.559470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aca47d-59b4-44a8-a06d-6b8325c36ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.578855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-96aca47d-59b4-44a8-a06d-6b8325c36ecb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:00.580335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96aca47d-59b4-44a8-a06d-6b8325c36ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:00.619008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:00.688444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c6003-59ed-468d-aa6e-11e0b9e79e96 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:00.690021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 363/733] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 24 09:56:00.695848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea04fe-32f3-4f7d-8c1b-a8faec00684a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.695848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea04fe-32f3-4f7d-8c1b-a8faec00684a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.695848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea04fe-32f3-4f7d-8c1b-a8faec00684a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.699320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 364/734] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:00.701387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.701678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.701957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.721143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:00.723478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:00.747035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:00.747881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.748167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.748544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.760644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:00.762551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:00.781774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:00.782739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:00.783666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:00.783666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:00.783666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:00.783666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:00.783666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 371/735] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:00.784616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:00.813791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 365/736] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:56:00.814909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:00.838113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:00.895152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:00.901944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c80b78-871d-4130-a576-3a0484166d49 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:00.939095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:00.939693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec82a4-c9b5-4156-b700-1352a76f69ba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:00.940340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.940779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.941209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.957406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:00.968251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:00.969448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:56:00.970454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:00.971874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 372/737] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:56:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:00.973641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:00.987131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:00.988475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:00.989237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:00.990006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:00.990950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:00.991431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:00.993250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.008018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 366/738] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:01.009151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.086958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4579f-3acc-4eb9-b78a-27bf08fc8aa2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.107583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.125167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.125989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.126259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.126739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.131586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3841-b24d-4628-b391-39be2fb3d14b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.138708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:01.149055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:01.150055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:01.150914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 373/739] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:01.151624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.173753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.174733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.175171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.175644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.176968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.177695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:01.178794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.180408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.190666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 367/740] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:01.192450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.289188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4cfd-a0ec-4576-834d-550f468cc648 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.323327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f395fd-ae13-40a6-a1d0-e05b740826b3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.335764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.336599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.336889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.337169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.346743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.348638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:01.367265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:01.368490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:01.369400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:01.369862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.369862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.370154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.370807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.371674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:01.372115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.372509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 374/741] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:01.373556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.373750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.387865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 368/742] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:01.389104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.396364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.476174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.499710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346c26-adc8-4f53-bfc0-56ad7e658df8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.525475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912b976-5157-4214-8a8d-f9e1ebc34f6b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.543198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.544221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.544653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.545070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.556140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.557581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.560758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.561411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.561692 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.561964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.562742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:01.563047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.564480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770cd20-9c6b-4baf-a41c-bd43b8b7feef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:01.575107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:01.576207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:01.577144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:01.577144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:01.577144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:01.577144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:01.577144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 375/743] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:01.577144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.581342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 369/744] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:01.583769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63082488-3a78-445f-8cb9-2373f158ea42 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.584335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63082488-3a78-445f-8cb9-2373f158ea42 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.584819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63082488-3a78-445f-8cb9-2373f158ea42 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.586614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 370/745] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:01.587485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63082488-3a78-445f-8cb9-2373f158ea42 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.659117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.679586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68bc73-b1f0-4c95-9022-bfd6b013e5a5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.700329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63082488-3a78-445f-8cb9-2373f158ea42 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.706206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.714663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.715456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.715735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.716044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.727062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.728534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.737330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.738001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.738899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.739180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.739935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:01.740243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.741594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe3b7f-5f10-4eb1-8dda-c6fc82e6f3ba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:01.746350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:01.747288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:01.748224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:01.748224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:01.748224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:01.748224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:01.752121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 376/746] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:01.752811 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.757510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 371/747] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:01.757510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.757510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.757510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.772302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:01.773497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:01.846902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 372/748] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 24 09:56:01.848705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.879370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6a6c1-b922-49ac-9e8e-52354a4100d7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.905248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:01.916875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:01.917534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:01.918818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:01.918818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:01.919162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=e7af6dbe9ff8421f80acf0405be3088c) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:01.919162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:01.920597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:01.932277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 377/749] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/role_assignments?user.id=e7af6dbe9ff8421f80acf0405be3088c&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:01.934288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:01.967007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1c985-c361-4544-853a-125bd8a2a1bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:01.998179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:02.017178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.017994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.018347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.018732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.019757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:02.020334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.021956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.036847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 373/750] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:02.037917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:02.068842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646c8a5-97a9-4497-9ceb-4a2c0ca30490 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.108790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.110445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.110929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.111358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.122697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.124437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:02.146199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:02.147431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:02.148662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:02.151250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 378/751] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:56:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:02.152516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:02.155454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986307-003e-445a-a3dd-85e16e4f365c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.177354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:02.191827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.192646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.193049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.193481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.194293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.195826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.281616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 374/752] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:02 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:02.282465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:02.300393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb8a9-aa8a-4ba0-a8a2-3606e0aa0172 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.306187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:02.380311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.381073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.381356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.381632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.397322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.398816 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:02.426648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:02.427724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:02.429051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:02.436050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 379/753] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:56:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:02.448439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:02.464562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639f386-9321-43f8-a184-e28d94dde3f4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.507821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.509067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.509563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.510037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.511151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:02.511655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.513524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.536593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 375/754] 10.222.0.44 () {56 vars in 1149 bytes} [Tue May 24 09:56:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:02.553773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:02.608237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:02.624834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfda0e-178d-4efa-a94a-edae86ebf424 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.663644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.664272 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.664599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.664876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.665721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:02.666027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.667531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.683385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9747a-b570-4738-b469-b58c56039202 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.687582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 380/755] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:56:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:02.693859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:02.740191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:02.762023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d82bb5-998c-487a-aba1-13c5bdc607b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.762861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82bb5-998c-487a-aba1-13c5bdc607b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.763854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82bb5-998c-487a-aba1-13c5bdc607b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.764245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d82bb5-998c-487a-aba1-13c5bdc607b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.855627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4d43d-8388-43bc-ace4-f6326ca1bfa2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:02.892969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:02.895348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:02.895743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:02.896155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:02.907669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:02.909294 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:02.929302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:02.930288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:02.931469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:02.931469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:02.931469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:02.931469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:02.931469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 381/756] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:02.936365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.022229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.025161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d82bb5-998c-487a-aba1-13c5bdc607b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.026988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d82bb5-998c-487a-aba1-13c5bdc607b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.049481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e9a4b-ae13-4ecf-9c92-81033e08f746 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.066093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.088669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.089493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.089980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.090479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.091765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:03.092159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.093550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69029e-3576-4c3f-99c5-92834d8f94e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.108474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 382/757] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:03.110129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51089ed-74a0-4fbc-b6bc-15ab5d9e74e8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.110423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51089ed-74a0-4fbc-b6bc-15ab5d9e74e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.110701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51089ed-74a0-4fbc-b6bc-15ab5d9e74e8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.117387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 383/758] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:03.118395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51089ed-74a0-4fbc-b6bc-15ab5d9e74e8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.154274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 376/759] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:56:03.157026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.157318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.157598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.186709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:03.187857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:03.244750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51089ed-74a0-4fbc-b6bc-15ab5d9e74e8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.280291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 377/760] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:03.280709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.281432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.289069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.290073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.290503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.291445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.299724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.301782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:03.320336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:03.321457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:03.322558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:03.325650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 384/761] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:03.327286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.371062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.414278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe817b3-a247-4f3d-8958-6fd581a47068 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.457812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.459235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.459668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.460383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.465035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c23a3-c08e-4a8a-99f0-166e4661f4f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.473564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.476061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:03.497225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:03.498147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:03.499043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:03.499043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:03.499043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:03.499043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:03.499043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 378/762] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:03.499762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.510358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.511178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.511462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.511741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.512431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.513929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:03.528347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:03.529325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:56:03.530168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:03.534643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 385/763] 10.222.0.44 () {56 vars in 1129 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:03.536152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.598059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.625177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3ecd-59a6-46e4-92a8-938ab8288a8c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.644991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.654084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf701d-1b86-4368-9fc4-e268b48049bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.671501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.672442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.673098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.673477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.674390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:03.674795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.677344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.693922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.694858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.695281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.695747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.696647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:03.697138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.698491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 379/764] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:03.699184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.699570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.715346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 386/765] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:03.716669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.805875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc1133-a006-439e-8f84-e9633b964c80 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.831049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04dd6-1cb0-4c77-a207-8e51869a0f22 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.840791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.841589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.841997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.842430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.843167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:03.843573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.845107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.848298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.850225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 380/766] 10.222.0.44 () {56 vars in 1124 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:03.851118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:03.872657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:03.873944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:03.874372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:03.876683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6dc6411c631a41d5a22ee51adca2b8f1/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:03.877152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=6dc6411c631a41d5a22ee51adca2b8f1, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:03.878945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:03.892475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:03.951581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f9ab-10fd-41d9-95f2-5903a024e79e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:03.982069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 387/767] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:03 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6dc6411c631a41d5a22ee51adca2b8f1/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:56:03.983213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.000541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.001252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.001578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.001858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.017076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.018559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:04.052353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:04.053391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:04.054322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 381/768] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:04.059840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.123266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07fde3-8005-4f23-9420-539b8a585495 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.167582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.168702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.170175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.170812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.179938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:04.179938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.179938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.181694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 388/769] 10.222.0.44 () {56 vars in 1124 bytes} [Tue May 24 09:56:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:04.191664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.262528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:04.288929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:04.293871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c00b2-4760-4331-abc7-ccc7d7373899 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.330528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1227b63-a2e1-4397-959f-e104114a86b3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.332634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.333300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.333578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.333852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.334639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:04.334949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.336423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24288-1457-450a-a251-f37a42a771a2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.352585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 382/770] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:04.352585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464798-028f-4dcd-9825-1a1918d2f9e7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.352585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464798-028f-4dcd-9825-1a1918d2f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.352585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464798-028f-4dcd-9825-1a1918d2f9e7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.352585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 383/771] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:04.360728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44464798-028f-4dcd-9825-1a1918d2f9e7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.375294 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.376371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.376853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.377411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.378217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] RBAC: Adding query filter params (interface=public, service_id=c2c6aa465f894042be27ef76ecee0f01, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:04.378513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.380344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075c8bd-3116-43f9-8e38-d9bc275930b5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.391938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 389/772] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/endpoints?service_id=c2c6aa465f894042be27ef76ecee0f01&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:04.393412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.393700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.393971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.414208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:04.415385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:04.490401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44464798-028f-4dcd-9825-1a1918d2f9e7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.512734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 390/773] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:04.514764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.543317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.544090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.544380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.544662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.545613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=651012f4a3124dcab018f1e7a11a59bf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:04.545936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.547481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.550303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:04.556849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 384/774] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/role_assignments?user.id=651012f4a3124dcab018f1e7a11a59bf&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:04.558075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.590269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:04.636957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c12f4-6d34-4f16-9ec0-50ef3aafe806 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.675163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.676276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.676951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.677336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.678370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.679820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.681716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4480-c697-4f72-9edd-ecadcf5f14bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.686661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 391/775] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:04.731764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdc03e-66bf-427a-ba49-8ce82066e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.732619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdc03e-66bf-427a-ba49-8ce82066e819 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.732904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdc03e-66bf-427a-ba49-8ce82066e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.733183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdc03e-66bf-427a-ba49-8ce82066e819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.758592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdc03e-66bf-427a-ba49-8ce82066e819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-98fdc03e-66bf-427a-ba49-8ce82066e819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:04.766689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:04.767907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:04.768998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:04.772320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 385/776] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:04.778341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.779251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974166c6-79c6-4566-9a31-203ca0289199 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.779543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974166c6-79c6-4566-9a31-203ca0289199 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.779845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974166c6-79c6-4566-9a31-203ca0289199 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.781454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 386/777] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:04.787180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.787469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.787749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.822991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:04.826597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:04.914759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 387/778] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:04.920264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:04.923129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41771e88-c3a7-4c70-93ae-af7d2f7a803a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:04.940005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:04.960235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:04.973767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:04.973767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:04.974085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:04.974334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:04.975192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:04.975506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:04.977499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:04.987911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 392/779] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:04.997308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.089658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fea85-356b-495f-9152-7e2f9ddf1a90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.154954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927169d2-3f4e-4da5-a2f2-dd01b6f8039b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.165421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.166228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.166510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.166785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.167448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.168855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:05.189402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:05.190529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:05.191522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 388/780] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:05.199495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.225705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.229162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.229460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.229746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.252774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.254819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:05.290043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:05.292301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:05.294512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:05.294512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:05.294512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:05.294512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:05.297486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 393/781] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:05.298423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.321019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:05.323142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:05.342479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c757463-5e16-4309-a65f-d068d6a6ca82 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.385441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.386218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.386511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.386787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.387502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:05.387827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.390194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.404747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 389/782] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:05.410733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.506239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba756f6-5812-4310-ae9d-1cd983a9d644 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.553482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50211ae-4078-4834-87be-7423d3e8335e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.556963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.557639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.557921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.558194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.558920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:05.559224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.560627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.584171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 394/783] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:05.589483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.613753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.614474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.614766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.615047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.615761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:05.616100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.617483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.636377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 390/784] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:05.643167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.652101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:05.738413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:05.764174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13bf8e-d7c6-4f68-a495-f9ff9cdd27f9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.799500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.800846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.801346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.801860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.809195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fb1cb-b7d7-4a13-a3bb-2ec09b30166b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:05.810124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.811787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:05.826670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:05.827655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:56:05.829397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:05.832747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 395/785] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:05.840745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:05.884577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:05.885170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:05.885454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:05.885730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:05.886524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] RBAC: Adding query filter params (interface=public, service_id=4bcc304f280b46f78c32dcae14c5e8b7, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:05.886831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:05.888232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:05.903191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 391/786] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/endpoints?service_id=4bcc304f280b46f78c32dcae14c5e8b7&interface=public®ion_id=RegionOne => generated 194 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:05.908988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:06.002709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395e504-47d3-4f99-9673-a2a2e5511945 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:06.024454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:06.047046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:06.061180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:06.061874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.062167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.062491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.063348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:06.063659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:06.065147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:06.100533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547d38-3b08-4af1-83f3-337fb5d6801a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:06.105255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 396/787] 10.222.0.44 () {56 vars in 1135 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:06.112805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:06.185816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:06.186484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.186777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.187058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.187784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:06.193302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:06.205871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 392/788] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:05 2022] GET /identity/v3/services => generated 772 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:06.298251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327724b1-b795-4483-ab73-2d72c5df480c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:06.357979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:06.358866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.359156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.359486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.377906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:06.380464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:06.409007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:06.410508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:06.411495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:06.411495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:06.411495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:06.411495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:06.411495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 397/789] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:06.416273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:06.527694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659ae35-38cc-452c-84dc-63c114be6e1a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:06.559780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:06.568951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:06.569633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.569923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.573042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.573042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:06.573042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:06.573042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:06.587517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 393/790] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:06.593015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:06.664175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:06.742104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4a49c-49c1-4020-be69-a63eaa4b3b3b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:06.796656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:06.797458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.797738 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.798011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.809322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:06.810777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-28c59a40-d37c-48db-a4c1-9556570b32f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:06.830153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:06.831137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:06.832799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 398/791] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:06.839318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:06.910940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5bb8-31e8-4d23-bf88-9d1b9600e8d7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.911289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5bb8-31e8-4d23-bf88-9d1b9600e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.911499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5bb8-31e8-4d23-bf88-9d1b9600e8d7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.913171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 399/792] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:06.918325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:06.918498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:06.918740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:06.939468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:06.940682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:06.996185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c14a3-64ac-4e4b-a62e-281cf0b987db None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.040228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.041323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.041822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.042313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.043342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:07.043934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:07.045630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:07.072231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 394/793] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:07.080748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.100152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 400/794] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:07.142504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.144785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:07.204174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:07.228710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec751f7-28a7-4499-9564-0e2f64a18ff6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.280668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ec0a-7230-4934-8d45-a63f2e0ec48b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.297186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3c5cf-5266-4903-858b-d53d13859b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.297937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c5cf-5266-4903-858b-d53d13859b1f None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.298219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c5cf-5266-4903-858b-d53d13859b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.298492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3c5cf-5266-4903-858b-d53d13859b1f None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/e7af6dbe9ff8421f80acf0405be3088c/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.300609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c5cf-5266-4903-858b-d53d13859b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=e7af6dbe9ff8421f80acf0405be3088c, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:07.302130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3c5cf-5266-4903-858b-d53d13859b1f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:07.319266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d974e63-8dd8-4c7d-ab75-80884b176aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.320153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974e63-8dd8-4c7d-ab75-80884b176aba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.320444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974e63-8dd8-4c7d-ab75-80884b176aba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.320724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974e63-8dd8-4c7d-ab75-80884b176aba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.331080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d974e63-8dd8-4c7d-ab75-80884b176aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7d974e63-8dd8-4c7d-ab75-80884b176aba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:07.339870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:07.340918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:07.342227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 401/795] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:07.343326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a364f9-88c1-4c5a-a283-4aa6e14041cf None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.343491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a364f9-88c1-4c5a-a283-4aa6e14041cf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.343765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a364f9-88c1-4c5a-a283-4aa6e14041cf None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.349684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 402/796] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:07.351264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbcd2-e4ee-42af-a98c-9a7c7f6f1767 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.351640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbcd2-e4ee-42af-a98c-9a7c7f6f1767 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.351849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbcd2-e4ee-42af-a98c-9a7c7f6f1767 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.354021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 403/797] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:07.354710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbcd2-e4ee-42af-a98c-9a7c7f6f1767 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.411833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 395/798] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:07 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/e7af6dbe9ff8421f80acf0405be3088c/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:56:07.411833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.411833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.411833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.449893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:07.452049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:07.465663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:07.478389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbcd2-e4ee-42af-a98c-9a7c7f6f1767 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.519013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.520934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.521236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.521519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.522392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:07.522763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:07.524485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a113dc-b5ea-44f7-8677-ff60976c1abe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:07.539154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 404/799] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:07.539154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.539154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.539154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.555831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 396/800] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:07.557106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.557821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:07.559149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:07.614149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:07.644656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 405/801] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:07.646451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.695000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398c4-8215-4f1a-9bfe-40ac9b7668da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.745181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.746232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.747099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.747386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.761664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:07.763534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:07.764613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:07.784271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837e12-6c5c-4f77-9d7f-507325607707 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:07.788149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:07.789129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:07.790187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:07.790187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:07.790187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:07.790187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:07.790187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 397/802] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:07.790505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.830573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.831417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.831764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.832073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.832863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:07.834252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:07.846679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:07.849528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:07.851558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 406/803] 10.222.0.44 () {56 vars in 1129 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:07.863655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:07.915238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:07.923381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f65eb-4853-4dc5-a45b-bf1d7083da51 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.962729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0965e-dfd3-4126-ad13-4117dd974a35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:07.969349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:07.970154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:07.970436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:07.970712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:07.985204 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:07.997497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:07.998447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:07.999312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 398/804] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:08.000535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.005117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.006628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.007500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.008345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.009382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:08.010056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.011713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.025943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 407/805] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:08.027068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.037807 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.111662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abed9-acfa-4b73-a668-be4536b62e62 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.138637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a828-9a44-4871-82cc-1f53901085a8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.147869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.148604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.148890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.149170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.149874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:08.150175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.151655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.156860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 399/806] 10.222.0.44 () {56 vars in 1124 bytes} [Tue May 24 09:56:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:08.157724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.178610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.179867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.181852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.182344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.182881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.183882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:08.184392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.186085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.195024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 408/807] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:08.196164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.268290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a65a-2b13-4bfb-a2e5-7bf1916353c9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.269801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.305781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.306933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.307040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cec1f-fd41-4161-888e-c3d2dda8f49b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.307512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.308055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.316706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.318674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:08.335611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:08.336635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:08.337575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:08.340502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 400/808] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:08.341676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.343449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1787620-faff-4852-85c0-59871e356789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.344159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1787620-faff-4852-85c0-59871e356789 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.344447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1787620-faff-4852-85c0-59871e356789 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.344792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1787620-faff-4852-85c0-59871e356789 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.345658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1787620-faff-4852-85c0-59871e356789 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:08.345972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1787620-faff-4852-85c0-59871e356789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.347657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1787620-faff-4852-85c0-59871e356789 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.353677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 409/809] 10.222.0.44 () {56 vars in 1124 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:08.354617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1787620-faff-4852-85c0-59871e356789 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.430887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.455200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f9304-e238-4727-8927-d7dc23231e4c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.467049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1787620-faff-4852-85c0-59871e356789 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.493603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.494785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.495410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.496005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.498977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.504814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.505651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.505874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.506157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.506992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:08.507303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.509010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.510530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.512163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.527823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 410/810] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:08.528666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:08.531197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:08.532076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:08.532981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:08.532981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:08.532981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:08.532981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:08.535845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 401/811] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:08.536885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.636209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5f3cc-c8c8-4d8b-8956-54dc891ce7c6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.643909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e8972-ee00-4d1d-8dda-a0500df83001 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:08.674494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.675213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.676345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.676717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.677467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.678582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.680053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.685234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdf6b8-38d2-4dd3-a93f-b3e9dc900aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:08.686214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf6b8-38d2-4dd3-a93f-b3e9dc900aff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.686699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf6b8-38d2-4dd3-a93f-b3e9dc900aff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.687177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf6b8-38d2-4dd3-a93f-b3e9dc900aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.761111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdf6b8-38d2-4dd3-a93f-b3e9dc900aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:08.763096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdf6b8-38d2-4dd3-a93f-b3e9dc900aff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:08.776330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 411/812] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:08.778630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.880898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:08.970066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 402/813] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:08.972620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1db919-a9d9-47d0-9164-b014e6212482 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:08.973032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1db919-a9d9-47d0-9164-b014e6212482 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:08.973314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1db919-a9d9-47d0-9164-b014e6212482 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:08.979191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 403/814] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:08.980965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1db919-a9d9-47d0-9164-b014e6212482 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:08.984962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2fb4-9e60-4faa-8c9c-2a7408820ae2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.027720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.028296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.029145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.029332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.029576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.030287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:09.030615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.032895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771e14-9909-4845-b04d-4998e05ca7bf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.045832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 412/815] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:09.047447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.048049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.048049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.072573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:09.075993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:09.130821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1db919-a9d9-47d0-9164-b014e6212482 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.163669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 413/816] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:09.168586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.193104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.193920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.194205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.194482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.202563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.217864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.220006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:09.241363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:09.242296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:09.243199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:09.243199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:09.243199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:09.243199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:09.245178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 404/817] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:09.246279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.281851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf7223-dd6b-4b58-a490-50de9718e2e8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.319369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.320235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.320524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.320805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.328898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.330422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.335032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:09.346860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:09.349626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 414/818] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:09.350581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.358374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69316e-bd40-4ce4-af4a-ff3d297da33f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.395749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99534935-b96c-439a-951f-75600f79b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.396961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99534935-b96c-439a-951f-75600f79b871 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.397462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99534935-b96c-439a-951f-75600f79b871 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.397947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99534935-b96c-439a-951f-75600f79b871 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.398811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99534935-b96c-439a-951f-75600f79b871 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.400433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99534935-b96c-439a-951f-75600f79b871 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-99534935-b96c-439a-951f-75600f79b871 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:09.413446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:09.414508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 24 09:56:09.415360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:09.422927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 405/819] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:09.424041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99534935-b96c-439a-951f-75600f79b871 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.455016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.464654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93f2bb-4d9e-4007-88fb-ed2117736dbb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.501892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.502319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.502605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.502882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.503699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:09.504249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.505631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.517833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 415/820] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:09.518923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.534105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99534935-b96c-439a-951f-75600f79b871 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.569749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.570772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.571257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.571731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.573055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:09.573583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.575227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.594478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 406/821] 10.222.0.44 () {56 vars in 1149 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:09.595608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.599439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.627081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d944f-7f92-4501-a2ab-e421a44d9ce4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.667550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.668304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.668537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.668836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.669592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:09.669904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.671503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.683836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 416/822] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:09.683836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.701094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.714251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114107c-1446-4904-8ce5-d1f60237c8de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.750739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.751980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.752517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.752999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.760977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.762638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:09.776760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:09.777693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:09.778594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:09.781053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 407/823] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:09.782026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.800084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23039e4-a2fe-473a-b01e-83d83b468d0c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.838565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.839455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.839758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.840085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.846615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.852519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.854104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:09.873506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:09.874438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:09.875363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:09.875363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:09.875363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:09.875363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:09.875363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 417/824] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:09.876610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.889987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4ffd7-e0b5-4219-a20c-4061bcab0835 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:09.924026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:09.924686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.924967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.925271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.925989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:09.926289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:09.927650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb583c6-0fea-4ac8-9381-1cd1e0806ffc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:09.932437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 408/825] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:09.933643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490c61-1921-4956-b16b-4b956ff5d53c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:09.933928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490c61-1921-4956-b16b-4b956ff5d53c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:09.934205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b490c61-1921-4956-b16b-4b956ff5d53c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:09.935578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 409/826] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:09.936114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490c61-1921-4956-b16b-4b956ff5d53c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:09.957641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:09.991489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a3f8a-3b31-4705-a241-5a3e61f87435 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.029451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.030375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.030804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.031252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.033507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:10.033825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.035383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd31fd4-10fc-4c20-884c-9302e171ac1d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.048149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 418/827] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:10.049291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b490c61-1921-4956-b16b-4b956ff5d53c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.049419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.049698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.049972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.071003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:10.072215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:10.080261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:10.089728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.090391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.090674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.103971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.103971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:10.103971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.103971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.105600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 410/828] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:10.105600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.151827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 419/829] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:10.151827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.210062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:10.239467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3f68-1485-47cb-b2c7-f264584f0038 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.254852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9e5d5-97eb-48e5-aa13-14bb261d4566 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.279343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.280083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.280310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.280583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.281315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.282847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.290379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.291191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.291477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.291820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.292785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6dc6411c631a41d5a22ee51adca2b8f1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:10.293099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.294528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.301053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 420/830] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:10 2022] GET /identity/v3/role_assignments?user.id=6dc6411c631a41d5a22ee51adca2b8f1&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:10.301830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.375450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 411/831] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:10.376486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.428525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77559382-4c4d-4d65-b843-411f0db18a3c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.461289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:10.480883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:10.485279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.486396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.486749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.487100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.497375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.504095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:10.519417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:10.520501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:10.521449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 421/832] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:10.527097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.570779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49753714-c9f2-4b1d-bfd2-fcde90baee85 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.614486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.615407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.615695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.616059 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.628836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:10.637610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:10.639485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:10.640640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 412/833] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:10.645111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.669008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4e25-d150-40de-afb8-e3cf954d447e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.710705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.712296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.712785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.713257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.714240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:10.714761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.716434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.730697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 422/834] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:10.736637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.766491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc67f93-fcc5-4e73-970b-fc0bda590c2d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.784365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:10.800394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:10.814229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.814904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.815184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.815463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.816780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:10.817092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.818925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.833357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 413/835] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:10.839231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:10.861160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f0d5-cc57-4f37-8171-94a925c325ff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.909433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.910692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.910970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.911243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/651012f4a3124dcab018f1e7a11a59bf/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:10.928872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=651012f4a3124dcab018f1e7a11a59bf, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:10.930308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:10.959116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ef26-ab42-4192-9006-9058d6e323be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:10.996723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:10.997525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:10.997807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:10.998082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.004096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 423/836] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:10 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/651012f4a3124dcab018f1e7a11a59bf/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:56:11.014058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.015596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:11.039453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:11.040458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:11.041369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:11.041369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:11.041369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:11.041369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:11.045813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 414/837] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:11.047502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.148859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:11.161684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fdf46-2ce1-404c-a87a-1d72a39b8379 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:11.201349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:11.202027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.202312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.202584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.203306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:11.203610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.205340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb57ca1-c464-4a8f-a96d-ba0b872ad630 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:11.218620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 424/838] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:11.224371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.232232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f4d17-f5fe-473a-b106-e08983ce430c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.232934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f4d17-f5fe-473a-b106-e08983ce430c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.233377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f4d17-f5fe-473a-b106-e08983ce430c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.235275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 425/839] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:11.242696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.243399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.243685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.248363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:11.267674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:11.269528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:11.345169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 426/840] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:11.361069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f89f1-93fc-45a2-b3db-2dfe961edbfc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:11.373478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.408542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:11.411079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.411634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.412140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.421679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.424300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:11.450867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:11.451850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 24 09:56:11.452825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:11.455520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 415/841] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:11.464300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.465738 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:11.489455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cf3ea-914f-4a95-86dc-cf48461a3200 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:11.534235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:11.535566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.536135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.536422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.537327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.539423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:11.555153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:11.556528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:11.557646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:11.558508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 427/842] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:11.565642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.579712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21098e7-87e3-41d1-8790-547159acf16d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:11.623938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:11.625003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.625495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.625990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.627549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:11.628110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.630775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:11.654870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 416/843] 10.222.0.44 () {56 vars in 1135 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:11.669783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.740788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b719c-104a-4b17-b893-342c95ee176d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:11.805993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863c61-b09a-42ac-93e6-1f771ddd10a1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:11.852533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:11.853740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.854026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.854306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.855472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:11.856165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:11.856445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:11.856718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:11.857423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:11.857725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.859104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:11.865433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:11.876318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 428/844] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:11.877439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:11.892777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:11.980850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:11.982970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:12.089862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd747d2-b787-47d9-b854-a07ab6f3f33f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:12.129831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:12.130901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.131382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.131913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.132809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:12.133329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:12.134887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:12.147280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 429/845] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:12.169759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 417/846] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:12.174228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:12.282408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:12.322934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57b979-1a3b-4b24-9161-dad9949451f9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:12.361109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bde042-0b74-475e-a651-49d913240862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:12.361910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bde042-0b74-475e-a651-49d913240862 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.362191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bde042-0b74-475e-a651-49d913240862 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.362466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bde042-0b74-475e-a651-49d913240862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.374957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bde042-0b74-475e-a651-49d913240862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:12.376467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bde042-0b74-475e-a651-49d913240862 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-85bde042-0b74-475e-a651-49d913240862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:12.394671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:12.395659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:12.396899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:12.396899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:12.396899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:12.396899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:12.396899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 430/847] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:12.403050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:12.446154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:12.509360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed200-a257-49be-9507-77f8a9028cf3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:12.544465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:12.545457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.545957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.546442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.547426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:12.547961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:12.549606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:12.566241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 418/848] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:12.568047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bde042-0b74-475e-a651-49d913240862 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:12.683040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bde042-0b74-475e-a651-49d913240862 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:12.707233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:12.719314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:12.720155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.720485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.720767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.728618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:12.730085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-360dffeb-edf8-4073-a2a4-e78b88205372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:12.746050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:12.747423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:12.748529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 431/849] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:12.756475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:12.775698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8625a85-9258-4ba0-bd6f-c6ae4a7b74a6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.776038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8625a85-9258-4ba0-bd6f-c6ae4a7b74a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.776286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8625a85-9258-4ba0-bd6f-c6ae4a7b74a6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.777910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 432/850] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:12.786094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.786380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.786660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.807840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:12.809458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:12.862301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:12.869657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e20fb-f92d-47cb-985d-73d035df60e9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:12.892826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 433/851] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:12.906101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:12.907122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:12.907604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:12.908186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:12.909402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:12.910294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:12.912109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:12.916643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:12.930625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 419/852] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:12.932306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:13.025635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf06980-20a0-4bc4-9e0b-926d4d873c91 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:13.039597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72429b-acbe-4aaf-a2c5-3a2f0e7ac745 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:13.040899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:13.063524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:13.064385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.064676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.064944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.065698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:13.068013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:13.078304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:13.079207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.079688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.080282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:13.081593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:13.082625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:13.083475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:13.085316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=e7af6dbe9ff8421f80acf0405be3088c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:13.085840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:13.087648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:13.088158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 434/853] 10.222.0.44 () {56 vars in 1132 bytes} [Tue May 24 09:56:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:13.089002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:13.103937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 420/854] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:12 2022] GET /identity/v3/role_assignments?user.id=e7af6dbe9ff8421f80acf0405be3088c&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:13.209417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463978f-8418-46f5-bfad-b435a3588740 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:13.252361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:13.253126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.253935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.254276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.254970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:13.255340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:13.256836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d451a-307d-4d15-998b-30de8c444970 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:13.262625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 435/855] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:13.268468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:13.295600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:13.380722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140947d0-f122-4ed0-8fbf-505498d86946 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:13.408970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89381750-8809-4e19-add8-9833cca97c33 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.409432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89381750-8809-4e19-add8-9833cca97c33 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.409771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89381750-8809-4e19-add8-9833cca97c33 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.412308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 436/856] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:13.417052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.417338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.417617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.418935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:13.419760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.420258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.420681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.421533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:13.421986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:13.424784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:13.431341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 421/857] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:13.442396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:13.443632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:13.486115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:13.526848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 437/858] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:13.550548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:13.650148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:13.667719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8029a33-57ae-4a5c-b36a-68feb7b20502 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:13.702897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:13.703753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.704635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.704911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.716160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:13.724870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:13.725824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:13.726661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 422/859] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:56:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:13.733868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:13.844185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa6eb-9d37-4a73-81d6-dc3877eb2903 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:13.881082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:13.881756 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:13.882039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:13.882315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:13.883062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:13.883366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:13.884783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:13.893603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 438/860] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:56:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:13.899828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:14.012035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c76468-9abc-4104-962d-5469196ea10e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:14.047084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:14.047961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.048247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.048523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.060086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:14.061540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:14.064168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:14.080205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:14.090045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:14.090944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:14.090944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:14.090944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:14.090944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:14.090944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 423/861] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:14.091221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:14.125276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:14.197397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb52173-1e56-45c8-9e8b-3aa58a208c84 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:14.235812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:14.236495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.236777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.237054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.238305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:14.238606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:14.240066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf2a53-72a5-4042-9cd0-c3be5a54ff74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:14.253681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 439/862] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:14.260978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:14.375573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac52b2d-a7aa-4471-b958-5e8875164b4d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:14.411064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:14.411904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.412187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.412492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.421192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:14.422633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:14.437649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:14.438645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:14.439587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 424/863] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:56:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:14.452379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:14.452960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2668-b50d-48d6-ac2e-a03a8b05fb82 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.453252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2668-b50d-48d6-ac2e-a03a8b05fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.453531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e2668-b50d-48d6-ac2e-a03a8b05fb82 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.455035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 440/864] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:14.461976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.462556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.463054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.481547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:14.483010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:14.523614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:14.564246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 441/865] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:14.576464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127e7ef-b349-48e2-b9b4-d4f880bef62a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:14.582871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:14.608319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:14.616996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:14.618024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.618325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.618605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.619442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:14.619750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:14.621413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:14.648919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 425/866] 10.222.0.44 () {56 vars in 1149 bytes} [Tue May 24 09:56:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:14.650955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:14.708402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1911d-979c-4c22-8daa-a648ac6659f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:14.763824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:14.763824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.763824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.763824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.764238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:14.764238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:14.780134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceab547-c68e-4b2a-8265-4ef3087cc84a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:14.795711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:14.815677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:14.816406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:14.816691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:14.816970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:14.840788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 442/867] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:14 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:14.904366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:14.905822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.021155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 426/868] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:15.026747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.113809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:15.138749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017444-3774-47fc-95a5-b224f2ebd74e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.175046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.175836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.176118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.176424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.188109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.189560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:15.208759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:15.209739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:15.211343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:15.211343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:15.211343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:15.211343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:15.211343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 443/869] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:15.215573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.239051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:15.334407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4412f7-9bf5-44eb-91ba-42526b9bdb0a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.370993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.372032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.372534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.373005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.373917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:15.374438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.376030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea3975-9156-42f8-9280-c99ee1d0b434 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.389191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 427/870] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:15.394945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.435982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14285b2-a732-45b0-898b-23816404f367 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.436179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14285b2-a732-45b0-898b-23816404f367 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.436469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14285b2-a732-45b0-898b-23816404f367 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.438131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 428/871] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:15.443890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.444190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.444467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.461857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:15.463042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:15.519622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862f0e-7e35-4d2b-934c-5d5fd6bc1894 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.544066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 429/872] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:15.553463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:15.558937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.560120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.561411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.561844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.563167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:15.563933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.572506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.574800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:15.593344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:15.594474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:15.595561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:15.598733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 444/873] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:15.604492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.675260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3737d94-1a77-4736-a0d6-aa98e066237d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.714108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.715182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.715542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.715953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.716808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.718297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.726397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a4f9-be03-431a-9b2a-a09786a7a80f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:15.732211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:15.733523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:15.734381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:15.739735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 430/874] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:15.740851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.768097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.769851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.770345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.770836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.772081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:15.772593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.774314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.792733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 445/875] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:15.793969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.813089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:15.848060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:15.851418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e1927-0661-4f89-a767-93d968471297 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.888499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.889160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.889459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.889723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.890420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:15.890722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.892132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5150965-5313-44cf-91ff-9808208abf45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.896994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 431/876] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:15.899300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70d063-6efc-4d64-81b8-5c4a854d8914 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:15.902558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c888-c220-4dc7-9489-178ccd79b68b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.902849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c888-c220-4dc7-9489-178ccd79b68b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.903130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c888-c220-4dc7-9489-178ccd79b68b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.908297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 432/877] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:15.908297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c888-c220-4dc7-9489-178ccd79b68b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:15.939087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:15.940057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.940344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.940646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.941467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=651012f4a3124dcab018f1e7a11a59bf) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:15.941784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:15.943321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf86349-b570-4db3-8769-f0a44f466b0c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:15.949296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 446/878] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/role_assignments?user.id=651012f4a3124dcab018f1e7a11a59bf&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:15.950418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:15.950704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:15.950980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:15.974110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:15.975154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:16.036568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c888-c220-4dc7-9489-178ccd79b68b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:16.070407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 447/879] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:16.071875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:16.080954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:16.082211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:16.082708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:16.083271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:16.084285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:16.084826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:16.086536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0428017-5b0c-40a4-899d-680fc772b3c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:16.092724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 433/880] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:16.094060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:16.150926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:16.215570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c3711-bce3-4f13-90da-c921ac368b2f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:16.254642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231d706-2a92-4f90-81b9-dee956b77409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:16.255244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231d706-2a92-4f90-81b9-dee956b77409 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:16.255525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231d706-2a92-4f90-81b9-dee956b77409 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:16.255903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231d706-2a92-4f90-81b9-dee956b77409 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:16.256549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231d706-2a92-4f90-81b9-dee956b77409 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:16.257961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231d706-2a92-4f90-81b9-dee956b77409 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:16.371164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 448/881] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:16 2022] POST /identity/v3/services => generated 269 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:17.157211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5222da-a062-4695-b9dd-57b02a1a7c8b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:17.157763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5222da-a062-4695-b9dd-57b02a1a7c8b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:17.157763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5222da-a062-4695-b9dd-57b02a1a7c8b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:17.159369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 434/882] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:17.164781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:17.165178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:17.165347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:17.183105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:17.184298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:17.267814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 449/883] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:17.290258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5222da-a062-4695-b9dd-57b02a1a7c8b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:17.400774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5222da-a062-4695-b9dd-57b02a1a7c8b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:17.447200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:17.448538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:17.449031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:17.449515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:17.450414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:17.452024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:17.469117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:17.470138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:17.470976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:17.474601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 435/884] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:17.480161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:17.510709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:17.584899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2e5be-bc32-4426-8806-33af1365d396 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:17.620748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:17.621424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:17.621701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:17.621973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:17.622673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:17.623032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:17.624515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:17.630453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 450/885] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:17.635654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:17.698837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:17.746776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c39f8-af72-4def-a9e5-2de495b858ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:17.781836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:17.782501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:17.782782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:17.783057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:17.783759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:17.784092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:17.785985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:17.791476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 436/886] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:17.797294 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:17.896622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:17.904277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1e3ff-113e-4b50-bc49-8920ffa3214c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:17.940213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:17.941285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:17.941775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:17.942252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:17.943241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] RBAC: Adding query filter params (interface=public, service_id=4dc20186d8d449ecb580d7c0420bf48c, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:17.943785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:17.945390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb2d7-b64b-4d60-b6d3-9ec0f0da5a46 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:17.952988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 451/887] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:17 2022] GET /identity/v3/endpoints?service_id=4dc20186d8d449ecb580d7c0420bf48c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:17.959904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:18.065346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd994-b3e0-4de8-be89-b0f524883b12 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:18.090567 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:18.102040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a3752-79ad-422b-be26-674259227236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:18.102930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3752-79ad-422b-be26-674259227236 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.103360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3752-79ad-422b-be26-674259227236 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.103780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a3752-79ad-422b-be26-674259227236 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.109697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a3752-79ad-422b-be26-674259227236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:18.109697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a3752-79ad-422b-be26-674259227236 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:18.112967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 437/888] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:17 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:56:18.332370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabc1f5-6123-47ce-87c7-b70b7bc4c8f3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.332912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabc1f5-6123-47ce-87c7-b70b7bc4c8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.332912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabc1f5-6123-47ce-87c7-b70b7bc4c8f3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.334405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 452/889] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:18.340092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.340977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.341476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.360152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:18.361691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:18.387879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab3af3-e936-4460-949a-4079954313cb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.388183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab3af3-e936-4460-949a-4079954313cb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.388438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab3af3-e936-4460-949a-4079954313cb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.390066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 453/890] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:18.395145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.395433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.395713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.414939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:18.416165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:18.452213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 438/891] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:18.479077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:18.504926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 454/892] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:18.529274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:18.595269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4350ab-a93c-4aff-9895-6d6868a7adae None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:18.614605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:18.621867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:18.634577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d5847-bf33-4675-a62e-16c4f16397df None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:18.638632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4230b8-6857-434c-9c91-67ad4dc48fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:18.639307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4230b8-6857-434c-9c91-67ad4dc48fb2 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.639588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4230b8-6857-434c-9c91-67ad4dc48fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.639891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4230b8-6857-434c-9c91-67ad4dc48fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.640631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4230b8-6857-434c-9c91-67ad4dc48fb2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:18.641996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4230b8-6857-434c-9c91-67ad4dc48fb2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:18.670346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:18.671454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.671925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.672371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.683990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:18.693276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:18.694298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:18.695209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 455/893] 10.222.0.44 () {56 vars in 1120 bytes} [Tue May 24 09:56:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:18.701554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:18.715911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 439/894] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:18 2022] POST /identity/v3/services => generated 241 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:18.722049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d710-c64a-4b62-92f8-d8e846ec4fc2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.722525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d710-c64a-4b62-92f8-d8e846ec4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.722817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d710-c64a-4b62-92f8-d8e846ec4fc2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.724553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 440/895] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:18.729810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591558-8066-4949-9730-4c760862a194 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.730103 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591558-8066-4949-9730-4c760862a194 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.730370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591558-8066-4949-9730-4c760862a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.749813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1c591558-8066-4949-9730-4c760862a194 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:18.751158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c591558-8066-4949-9730-4c760862a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:18.837940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301063e2-498a-4192-8ce4-600daab58aac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:18.848412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 441/896] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:18.868410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591558-8066-4949-9730-4c760862a194 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:18.880301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:18.881588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:18.882155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:18.882647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:18.883651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:18.884484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:18.886277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:18.902285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 456/897] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:56:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:18.904143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:18.920239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:18.990990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591558-8066-4949-9730-4c760862a194 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:18.994105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:19.025489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b4857-9bc9-4dac-8a26-cfc8d257fe29 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.038413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.039241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.039525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.039837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.040493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.041882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:19.057379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:19.058582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:19.059661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 442/898] 10.222.0.44 () {56 vars in 1132 bytes} [Tue May 24 09:56:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:19.067251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.079682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.081828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.082321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.082611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.099935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.102063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:19.131052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:19.132097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:19.133025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:19.133025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:19.133025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:19.133025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:19.135879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 457/899] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:19.138255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.195142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec7c4-4c52-4b95-8d9d-1783bf1f86ec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.224117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:19.239027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.239732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.240045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.240415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.241034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:19.241341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.242782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.254549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 443/900] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:19.255455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.283989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b604c6a-bcc0-4caa-8c3f-951995449c6c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.295636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:19.329245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.329917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.330205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.330556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.331238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:19.331546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.333029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.345863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 458/901] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:19.352274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.388747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b96665-e8ea-4e9a-9a53-b00b86cc9933 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.434220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.434892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.435180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.435459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.436208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:19.436519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.437899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.455118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 444/902] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:19.456053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.496828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543e9d-d895-44c4-9e56-f4e5599c1ad0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.526104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:19.543507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.544894 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.546230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.546709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.556500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.559031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.573431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:19.579654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72dac4-3186-43ff-b7e8-f7132ab4074c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:19.585068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:19.586040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:19.586992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 459/903] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:19.590570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.618993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.620006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.620243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.620638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.621533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] RBAC: Adding query filter params (interface=public, service_id=7bb80c98fdee431d8d7dc7599beb0e35, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:19.621984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.623610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.633967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 445/904] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/endpoints?service_id=7bb80c98fdee431d8d7dc7599beb0e35&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:19.635218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.718370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec4546-76ea-4fb2-86f9-2e181cb118e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.754387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.755247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.755672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.756021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.756983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:19.757368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.758910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.760152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dc53a-3eda-41d4-91bc-6b158c0b1c58 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.777833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 460/905] 10.222.0.44 () {56 vars in 1149 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:19.787822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:19.804785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.805570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.805950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.806301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:19.807207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:19.808720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:19.816438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 446/906] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:56:19.833228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:19.902703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a368587-1e80-42e3-97de-848ccb868c49 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:19.941960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:19.942768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:19.943053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:19.943328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.023552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.025054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.069950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:20.130916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 461/907] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:56:20.136699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.166360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:20.247480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b956f27-121a-434c-be7e-dc5ffb6dc7be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:20.286432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:20.287243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.287530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.287822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.298667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.301120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f88d1937-c309-4dad-b72c-fdd5c0ba056a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:20.319779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:20.320731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:20.321861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:20.321861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:20.321861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:20.321861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:20.321861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 447/908] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:20.328399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.432540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11ba8-ec86-499d-890f-9bc0de4bf43d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:20.437183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffbd1-ce76-4c63-8ce9-7c7e707c6aaf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.437608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffbd1-ce76-4c63-8ce9-7c7e707c6aaf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.437898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afffbd1-ce76-4c63-8ce9-7c7e707c6aaf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.439389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 448/909] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:20.444822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.445107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.445381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.465814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:20.467515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:20.472994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:20.473661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.473941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.474215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.474933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:20.475237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.476630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.485752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:20.494437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 462/910] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:20.495922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.552179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 449/911] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:20.570862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.581366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:20.621237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338537f-cccd-4604-8d0d-02b4b16c900c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:20.672177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:20.672997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.673281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.673558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.683375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.685165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.688880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef114e-98b2-4dc9-ac31-ded5ab68524f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:20.704961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:20.705925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:20.707121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:20.711132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 463/912] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:20.712476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.733307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:20.734481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.735016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.735487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.736439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.738887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:20.751669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:20.752733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 24 09:56:20.753614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:20.761386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 450/913] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:20.762554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.786642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:20.838385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:20.850922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec9b64-e6e1-4e48-b59c-d2179b43ef40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:20.871914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ee1f-35b3-4ddd-9f35-aace879318e0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:20.896601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:20.897209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.897495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.897774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.898554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:20.898863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.900433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.909036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:20.910063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:20.910552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:20.911053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:20.912013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:20.912570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:20.914308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:20.918767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 464/914] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:20.920255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:20.926870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 451/915] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:20.928355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.035277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac001cc2-3a42-4b22-aa9e-22dcf06443df None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.036025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0572d1-3015-4eb1-a069-4f0d4df52f93 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.058546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:21.071707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.081734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.081734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.081734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.081734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:21.081734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.082108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.082108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.082265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.082342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.082342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.082475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:21.082546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] RBAC: Adding query filter params (role.id=d089f095fa064fbe915d715b6614613c, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=651012f4a3124dcab018f1e7a11a59bf) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:21.082546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.082546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbc07e-18ed-4fb2-a4cc-ca781eabe061 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.088572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 452/917] 10.222.0.44 () {56 vars in 1114 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:21.089882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.091295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 465/917] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:20 2022] GET /identity/v3/role_assignments?user.id=651012f4a3124dcab018f1e7a11a59bf&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=d089f095fa064fbe915d715b6614613c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:21.118686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ebaad-124d-4aaf-b144-528daadf2e3e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.118888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ebaad-124d-4aaf-b144-528daadf2e3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.119189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ebaad-124d-4aaf-b144-528daadf2e3e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.121054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 466/918] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:21.126803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.127165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.127377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.146632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:21.147904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:21.224669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 467/919] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:21.229684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46285a-58c0-4104-8352-c47565e9ed0e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.252244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.274775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.275450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.275738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.276048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.277291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.279014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.359050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc86d6-6ba0-499b-8976-b7438f15ef27 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.376300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 453/920] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:21.389309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:21.421418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.422506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.422938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.423669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.424658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.426593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:21.441438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:21.443156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:21.444221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:21.446751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 468/921] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:21.453527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.517340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:21.568360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d7098-1429-43e5-b3cc-8bd96f5cd928 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.605348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.606020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.606305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.606586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.607300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:21.607608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.609017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.614847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 454/922] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:21.620357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.725961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ea377-df13-4792-b714-8dedf7cc50a5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.761190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.762233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.762714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.763203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.764150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:21.764707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.766384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.772599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 469/923] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:21.780384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.883387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b5a97-8e6c-44cc-ab88-679587d169df None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:21.904956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:21.922079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:21.922751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:21.938439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:21.938439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:21.938439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] RBAC: Adding query filter params (interface=public, service_id=a6c432f635af40418a02561f8ef875bb, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:21.938439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:21.938439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa04eb-b187-4efe-bf67-3f671d2a9e7b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:21.938439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 455/924] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:21 2022] GET /identity/v3/endpoints?service_id=a6c432f635af40418a02561f8ef875bb&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:21.940064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:21.989964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:22.054819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb52c-6c2e-46bf-a3d0-dc9464bed658 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:22.090744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd13c5-c476-4fee-9666-3fd8fd429100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:22.091405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd13c5-c476-4fee-9666-3fd8fd429100 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.091685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd13c5-c476-4fee-9666-3fd8fd429100 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.092055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd13c5-c476-4fee-9666-3fd8fd429100 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.092734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd13c5-c476-4fee-9666-3fd8fd429100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:22.094109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd13c5-c476-4fee-9666-3fd8fd429100 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:22.101283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 470/925] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:21 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:56:22.147029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8f14-d28f-4a87-91c0-62dd57311196 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.147224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8f14-d28f-4a87-91c0-62dd57311196 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.147504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c8f14-d28f-4a87-91c0-62dd57311196 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.149381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 456/926] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:22.155020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.155329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.155584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.174247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:22.175523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:22.250706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 471/927] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:22.274817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c8f14-d28f-4a87-91c0-62dd57311196 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:22.383213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c8f14-d28f-4a87-91c0-62dd57311196 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:22.417767 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:22.418508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.418788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.419060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.419712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:22.421127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:22.434029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:22.435041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:22.435946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 457/928] 10.222.0.44 () {56 vars in 1132 bytes} [Tue May 24 09:56:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:22.444164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:22.474224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:22.544143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db81b6-c799-4191-ab1b-9f9e6638bb73 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:22.581601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:22.582265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.582546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.582813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.583514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:22.583835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:22.585212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:22.590425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 472/929] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:22.596035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:22.647127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:22.701943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349a953-56f0-4b0b-8992-8a1bd8d95701 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:22.736378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:22.737049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.737885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.738241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.738947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:22.739252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:22.740643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808742e5-6da2-4b71-bf21-5234fb6482e9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:22.745892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 458/930] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:22.751429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:22.850808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:22.856897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbb2ba-383f-4e46-a7e7-56d86351020b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:22.891516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7fd0-c0b4-4fbd-93a4-9c57c961eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:22.892225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7fd0-c0b4-4fbd-93a4-9c57c961eb13 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:22.892513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7fd0-c0b4-4fbd-93a4-9c57c961eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:22.892791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7fd0-c0b4-4fbd-93a4-9c57c961eb13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:22.893576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7fd0-c0b4-4fbd-93a4-9c57c961eb13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:22.894948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7fd0-c0b4-4fbd-93a4-9c57c961eb13 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:23.010082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 473/931] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:23.405664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277255-6895-4c0c-a62e-5bc0f71eb03a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:23.406067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277255-6895-4c0c-a62e-5bc0f71eb03a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:23.406244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277255-6895-4c0c-a62e-5bc0f71eb03a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:23.407872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 459/932] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:23.413838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:23.414132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:23.414414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:23.433201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:23.434035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:23.508541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 474/933] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:23.530779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277255-6895-4c0c-a62e-5bc0f71eb03a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:23.643049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277255-6895-4c0c-a62e-5bc0f71eb03a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:23.660428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:23.679752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d046d9-f87c-407a-8fe2-c5bae33bbdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:23.680852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d046d9-f87c-407a-8fe2-c5bae33bbdba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:23.681236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d046d9-f87c-407a-8fe2-c5bae33bbdba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:23.681640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d046d9-f87c-407a-8fe2-c5bae33bbdba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:23.695870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d046d9-f87c-407a-8fe2-c5bae33bbdba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d7d046d9-f87c-407a-8fe2-c5bae33bbdba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:23.707620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:23.708637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:23.709503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 460/934] 10.222.0.44 () {56 vars in 1120 bytes} [Tue May 24 09:56:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:23.715228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:23.778499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff8d78-24fb-47a1-ad22-130d6cb6c2a2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:23.779127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff8d78-24fb-47a1-ad22-130d6cb6c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:23.779631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff8d78-24fb-47a1-ad22-130d6cb6c2a2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:23.781433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 461/935] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:23.787015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:23.787304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:23.787581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:23.794939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:23.810157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:23.811518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:23.818475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f76de-970e-4d63-8e85-1b934d310cc0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:23.856697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:23.857824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:23.858305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:23.858820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:23.859645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:23.860044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:23.861576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:23.875272 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 475/936] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:56:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:23.876624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:23.906654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 462/937] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:23.930851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.001462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17f3ea-632c-4a33-b07f-bc3be4f6cc80 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.041007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.042217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.042730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.043217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.054285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.057012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.058836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.060659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.064006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b8e5e-85b0-4b48-ab19-55cba5447d71 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:24.083372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:24.084382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:24.085284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:24.085284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:24.085284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:24.085284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:24.087553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 476/938] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:24.093424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.108191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.109268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.109820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.110301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.111221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.113685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.115401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING keystone.server.flask.common [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 24 09:56:24.150765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 09:56:24.150765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 24 09:56:24.150765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [parameters: {'id': '365540e4b0114505892f4e09298c66ae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 24 09:56:24.150765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 365540e4b0114505892f4e09298c66ae.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 365540e4b0114505892f4e09298c66ae. May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:56:24.171015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 24 09:56:24.171956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return project_ref.to_dict() May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() May 24 09:56:24.172958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 09:56:24.173856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application c = connection._execute_20( May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 09:56:24.174983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:56:24.176012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'id': '365540e4b0114505892f4e09298c66ae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.177006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:24.177805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict( May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 365540e4b0114505892f4e09298c66ae. May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.178791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 463/939] 10.222.0.44 () {60 vars in 1140 bytes} [Tue May 24 09:56:23 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:24.185926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.227814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d617a35-d91d-4512-90a2-73bb4baea475 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.266872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.267560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.267918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.268154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.269153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:24.269461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.270956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.286771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 477/940] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:24.292433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.320614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407d62-2e28-4d7d-8fad-098759147995 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.355815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.363399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.364351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.364632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.365197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.373865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.375526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:24.390432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:24.391585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:24.392739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.396669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 464/941] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:24.397348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.420006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ff7bd-d422-4e39-8a26-e77395e7dccb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.428297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.463933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.465008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.465288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.465559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.474246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.475690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-46598a37-db8b-445e-a341-f93621359d83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:24.490428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:24.491478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:24.493122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 478/942] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:24.493732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a139-5774-4455-b967-4ecce271b3bc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.493732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a139-5774-4455-b967-4ecce271b3bc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.493732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125a139-5774-4455-b967-4ecce271b3bc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.495833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 479/943] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:24.497691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a139-5774-4455-b967-4ecce271b3bc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.525164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3858-0469-4174-be81-1a9d273cc6e6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.560360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.561014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.561305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.561569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.562310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:24.562611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.564120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9392be-49a6-482d-a7f2-c8eff9bfd850 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.585018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 465/944] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:24.589780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.590462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.590946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.611360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125a139-5774-4455-b967-4ecce271b3bc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.614040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:24.615646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:24.630339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.656540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.657599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.658114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.658591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.660513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:24.661184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.662951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.685633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 480/945] 10.222.0.44 () {56 vars in 1149 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:24.691147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.704608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 466/946] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:24.729433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.740373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.811566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fc86f-9318-4598-80e2-0bc7369ce3f8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.851326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.852165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.852444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.852765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.863344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48a1a0-782a-449a-aeaf-c7e1db7ede3b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:24.866301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.867813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:24.887066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:24.888230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:24.889354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:24.889354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:24.889354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:24.889354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:24.890933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 481/947] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:24.897221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:24.905596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:24.906619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:24.907052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:24.907487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:24.908334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:24.910023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:24.923147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:24.924383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:24.925284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:24.926042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:24.928135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 467/948] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:24.934943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.007909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898f807-5d8d-4c43-b48a-fd8e9bc022b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.011717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:25.044703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf0deb-14ea-4f9d-b257-2b8cc3a0fdb2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.046665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.047499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.048013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.048596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.049460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:25.050653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.052295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.065721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 482/949] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:25.071432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.089498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.090065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.090347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.090621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.091327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:25.091631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.093072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.103345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 468/950] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:25.104632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.170369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:25.191209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86294b21-ab4b-4f45-9a62-50e1bf725a71 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.215117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70c2c7-b70b-4a54-abe2-060f3a13fae9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.230387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.231374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.231652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.232659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.243460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.244965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:25.260638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:25.261626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:25.262598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:25.264401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.265262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.265702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.266515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.266893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 483/951] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:25.267661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:25.267884 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.268633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.270311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.272183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:25.278975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 469/952] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:25.286047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.378812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5246f-4d9e-4f7f-a852-75dd47e7f32c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.405930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4835f1-d068-4836-b07c-7eeb277d323a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.415284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.416080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.416367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.416641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.417497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:25.417807 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.419255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dbd35-b2fe-4d0a-b7ee-02e119e4dcda None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.432486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 484/953] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:25.434679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f195a39-4189-4dda-b94a-21f5b357cbe4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.435380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f195a39-4189-4dda-b94a-21f5b357cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.435969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f195a39-4189-4dda-b94a-21f5b357cbe4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.438549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 485/954] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:25.439425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f195a39-4189-4dda-b94a-21f5b357cbe4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.443731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:25.450977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c081a5-a9ea-451c-a953-acabb04733c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.451717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c081a5-a9ea-451c-a953-acabb04733c5 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.452108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c081a5-a9ea-451c-a953-acabb04733c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.457026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c081a5-a9ea-451c-a953-acabb04733c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.457026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c081a5-a9ea-451c-a953-acabb04733c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.457026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c081a5-a9ea-451c-a953-acabb04733c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.556643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 470/955] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:25.558691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.558990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.559277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.562101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f195a39-4189-4dda-b94a-21f5b357cbe4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.600468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.601382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.601658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.601930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/651012f4a3124dcab018f1e7a11a59bf/roles/d089f095fa064fbe915d715b6614613c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.604312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=651012f4a3124dcab018f1e7a11a59bf, role_id=d089f095fa064fbe915d715b6614613c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.604865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:25.605793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.606086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:25.664177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:25.683726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 471/956] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:25.689185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 486/957] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:25 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/651012f4a3124dcab018f1e7a11a59bf/roles/d089f095fa064fbe915d715b6614613c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:56:25.707301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.836858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7a3f-defb-45a9-98b9-12c032e4615d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:25.875522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:25.876375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:25.876655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:25.876930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:25.877586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:25.879653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:25.892144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:25.893250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:25.894220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 472/958] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:25.901158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:25.966903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:26.012833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792c2b2-d7b1-45d0-9295-296832f1655d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:26.047606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:26.048308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:26.048815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:26.049098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:26.050382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:26.050697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:26.052275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2a67e-5044-46e4-a628-369306163608 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:26.057904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 487/959] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:26.063274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:26.116006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:26.172351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dd227-fe08-485f-8eb1-694888d87f9d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:26.210680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:26.211728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:26.212251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:26.212733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:26.213641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:26.214173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:26.215765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cdd77-d62c-4492-bb1d-38b892558ac3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:26.221065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 473/960] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:26.947696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bfa27-32f9-4631-b6d2-e3d1b3308118 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:26.948523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bfa27-32f9-4631-b6d2-e3d1b3308118 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:26.948793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bfa27-32f9-4631-b6d2-e3d1b3308118 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:26.950223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 488/961] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:26.955643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:26.956691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:26.956768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:26.974507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:26.975697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:27.051066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 474/962] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:27.075704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bfa27-32f9-4631-b6d2-e3d1b3308118 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:27.179647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bfa27-32f9-4631-b6d2-e3d1b3308118 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:27.203343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:27.215587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:27.216282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:27.216560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:27.216831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:27.217942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:27.219382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:27.220767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING keystone.server.flask.common [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 24 09:56:27.276219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 09:56:27.276219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 24 09:56:27.276219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [parameters: {'user_id': '0aa111b0d41b4b16a34465b4c42c499f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 24 09:56:27.276219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() May 24 09:56:27.284950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:56:27.287346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 24 09:56:27.289746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 24 09:56:27.292000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = connection._execute_20( May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 24 09:56:27.297329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 24 09:56:27.299328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'user_id': '0aa111b0d41b4b16a34465b4c42c499f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:27.302297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 24 09:56:27.304249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:27.307315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 489/963] 10.222.0.44 () {60 vars in 1131 bytes} [Tue May 24 09:56:27 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:27.308262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:27.353583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:27.419467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2d79-a7a5-430f-ac76-db5d071ade9c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:27.458710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:27.460019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:27.460510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:27.460989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:27.469226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:27.470962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a068a441-c1f1-4b2e-8490-315b6bcbc4ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:27.486932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:27.488560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 24 09:56:27.489545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:27.492349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 475/964] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:27.499928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:27.604520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce8130-a503-4311-b85a-e79a69762460 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:27.639833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:27.640520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:27.640800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:27.641073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:27.641873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:27.642175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:27.644356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f531a65-10f4-4f4d-8f45-11d55a8b7815 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:27.686554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 490/965] 10.222.0.44 () {56 vars in 1101 bytes} [Tue May 24 09:56:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:27.960448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ade26-9ee8-46ff-8463-0ab1e2daecdc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:27.960959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ade26-9ee8-46ff-8463-0ab1e2daecdc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:27.961072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ade26-9ee8-46ff-8463-0ab1e2daecdc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:27.962631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 476/966] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:27.967963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:27.968463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:27.968623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:27.987463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:27.989007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:28.027085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.049387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe886d-8d86-4e18-83bb-6dce1288553a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.049701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe886d-8d86-4e18-83bb-6dce1288553a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.049986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe886d-8d86-4e18-83bb-6dce1288553a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.051480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 477/967] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:28.056794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.057036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.057414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.064298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 491/968] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:28.078426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:28.079608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:28.083177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.157648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 478/969] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:28.178688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.183185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c49a6-45e7-4c92-89a7-0b3867153073 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.211417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.226481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.228088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.228540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.233940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.239937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:28.248151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:28.249122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:28.250009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 492/970] 10.222.0.44 () {56 vars in 1120 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:28.255567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.290417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0b7b4-0d87-4d10-b825-e1d29bd06e81 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.290730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.329386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.330216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.330500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.331298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.332030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.333456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:28.351305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:28.352627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:28.353531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:28.355937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 479/971] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:28.358941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.368721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170778b-4331-4811-b0d5-318e3360ad6c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.406071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.406741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.407065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.407663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.408158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:28.408467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.410476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.423883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 493/972] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:28.424982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.466535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.473527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244dd39-eb38-4bd2-925e-8de6b3835805 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.509904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.510581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.510869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.511150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.511910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:28.512227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.513594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ffe89-c815-41af-b661-01b9afe3f9c3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.519209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 480/973] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:28.520479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc46e1-1ef5-47cc-88dc-9d39c9b89a65 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.520772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc46e1-1ef5-47cc-88dc-9d39c9b89a65 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.521093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc46e1-1ef5-47cc-88dc-9d39c9b89a65 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.522319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 481/974] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:28.524512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc46e1-1ef5-47cc-88dc-9d39c9b89a65 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.533667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.542023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f2f7d-f826-4dc9-8867-49fd4c24b6f3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.576357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.577147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.577432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.577710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.588611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.590052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e8400a5c-c8e3-467a-a61f-e5a62c715f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:28.607930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:28.609061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:28.610369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:28.610369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:28.610369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:28.610369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:28.612142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 494/975] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:28.613648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.613937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.614217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.627470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc46e1-1ef5-47cc-88dc-9d39c9b89a65 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.630959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:28.632575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:28.661004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.661668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.661950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.662224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.662911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:28.663211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.664664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.669495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 482/976] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:28.670258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.695296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.702320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 495/977] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:28.703158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.769750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69d692-1bbf-4d88-b7b9-6e6b87f3add7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.779863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.802585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca18d48-2eb4-449c-a2d3-641aeb684d74 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.804758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.805518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.805811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.806143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.806866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:28.807171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.808568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.821204 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 483/978] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:28.821834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.838113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.838908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.839189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.839465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.840288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] RBAC: Adding query filter params (interface=admin, service_id=a6c432f635af40418a02561f8ef875bb, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:28.840602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.841972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.847696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 496/979] 10.222.0.44 () {56 vars in 1249 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/endpoints?service_id=a6c432f635af40418a02561f8ef875bb&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:28.848487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:28.906481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:28.922185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cae70-23ab-4b37-b90b-41a97851acc3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.947557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30676d34-c324-4fed-88e6-8fca51066b29 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:28.957590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.958255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.958543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.958824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.959541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.960964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.980903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:28.981694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:28.981976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:28.982250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:28.990385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:28.991838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:28.994297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:29.006426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:29.008550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 497/980] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:56:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:29.009740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:29.040405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 484/981] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:28 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:29.040405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:29.127269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c162b-ee19-4f1f-affb-46bbcfcbe338 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:29.162583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2177-c4f0-4e49-99da-cb7ebbb8346e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:29.166985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:29.167661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:29.167977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:29.168255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:29.168953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:29.170389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:29.179377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 498/982] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:29 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:56:29.206858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:29.208060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:29.208345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:29.208621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:29.209497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:29.209808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:29.211336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:29.223748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:29.234167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 485/983] 10.222.0.44 () {56 vars in 1149 bytes} [Tue May 24 09:56:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:29.241473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:29.312026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:29.356962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb4cd3-ef48-4ccc-a623-5b80fac0e7c9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:29.394302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:29.395055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:29.395337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:29.395608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:29.467084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:29.468597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:29.530063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:29.569914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 499/984] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:29.575160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:29.675406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53ab8-5bce-427a-84d8-9bf8a0668e07 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:29.710171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:29.710955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:29.711233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:29.711524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:29.721296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:29.723271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:29.740959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:29.742080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:29.743161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:29.743161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:29.743161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:29.743161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:29.744113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 486/985] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:29.747678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:29.845779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904723e1-1094-476a-acd2-10c63838e082 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:29.880004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:29.880668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:29.880949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:29.881224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:29.881937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:29.882242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:29.883612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:29.900154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 500/986] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:29.901555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:29.954244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:30.005239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba380c-ecb4-4840-bf97-48c129b681e5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:30.038557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:30.039354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:30.039642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:30.039955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:30.046618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:30.048088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:30.063702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:30.064608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:30.066098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:30.067167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 487/987] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:30.071362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:30.098028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:30.172317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5be180-b2ec-4430-af89-df10bdbb0099 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:30.208852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:30.209614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:30.209869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:30.210144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:30.210980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:30.211292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:30.212766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c5eb-2b78-430a-b60e-1cb9d6631898 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:30.225408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 501/988] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:30.231208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:30.338699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00598d-1453-4b91-a450-2d0f58ca2b47 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:30.350347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:30.376103 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:30.376765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:30.377049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:30.377490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:30.378455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] RBAC: Adding query filter params (role.id=d089f095fa064fbe915d715b6614613c, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=651012f4a3124dcab018f1e7a11a59bf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:30.379149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:30.381283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa4478-812c-4c2d-bdb5-f05cb7f13ebc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:30.395844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 488/989] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:30 2022] GET /identity/v3/role_assignments?user.id=651012f4a3124dcab018f1e7a11a59bf&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=d089f095fa064fbe915d715b6614613c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:31.300917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99ecf7-4a04-47c1-9ade-bb791e436919 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.301442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99ecf7-4a04-47c1-9ade-bb791e436919 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.301556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99ecf7-4a04-47c1-9ade-bb791e436919 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.302967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 502/990] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:31.308037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27638a-f459-4980-9947-113327efcde4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.308412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27638a-f459-4980-9947-113327efcde4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.308578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27638a-f459-4980-9947-113327efcde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.325699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1b27638a-f459-4980-9947-113327efcde4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:31.326932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1b27638a-f459-4980-9947-113327efcde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:31.392564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f806-d538-411f-9898-648df1773a6c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.392892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f806-d538-411f-9898-648df1773a6c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.393640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802f806-d538-411f-9898-648df1773a6c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.395449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 503/991] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:31.403883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 489/992] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:31.404029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.404029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.404029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.417796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:31.418973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:31.421341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27638a-f459-4980-9947-113327efcde4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:31.494736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 504/993] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:31.517377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:31.528574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27638a-f459-4980-9947-113327efcde4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:31.532388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:31.534199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:31.569153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:31.569954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.570243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.570568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.571414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:31.573084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:31.585784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:31.586916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:31.588384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 490/994] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:31.593872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:31.628669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7344-738c-4e03-ac0e-a6528cc6e088 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:31.667398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:31.668367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.668684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.668939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.669596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:31.671034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:31.687699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:31.688781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:31.692802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 505/995] 10.222.0.44 () {56 vars in 1126 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:31.695623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:31.704532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053fe9-40ef-4098-b971-163eb758581f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:31.739505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:31.740199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.740486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.740766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.741467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:31.741775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:31.743145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:31.748160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 491/996] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:31.753725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:31.786341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:31.788097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:31.813774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610b44-bc6d-4641-8ae7-b08810d27640 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:31.854495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:31.855077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.855366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.855744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.856644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:31.856755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:31.858280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:31.859530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb9e43-f488-43c2-b603-5bd77f068fb5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:31.868633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 506/997] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:31.869913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:31.900226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:31.900896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:31.901187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:31.902208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:31.902931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:31.903242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:31.905020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:31.912904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 492/998] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:31.918763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:32.008601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d595f-3d26-4b6f-9bad-e279d4e7caad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:32.050953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:32.052286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:32.053043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.053328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.053607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.054320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:32.054627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:32.056058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:32.057783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07204c37-0686-428c-b60f-6477cea5406a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:32.061600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 507/999] 10.222.0.44 () {56 vars in 1122 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:32.067123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:32.078641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:32.108583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:32.109240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.109524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.109797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.110698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] RBAC: Adding query filter params (interface=public, service_id=c33a31b991db49f49a7862de491196ae, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:32.111014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:32.112539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:32.122443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 493/1000] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:31 2022] GET /identity/v3/endpoints?service_id=c33a31b991db49f49a7862de491196ae&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:32.123842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:32.200662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4301b-1a8d-46d9-9490-58d532ff2d35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:32.242329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2186-770f-4679-a97f-b84d6e444367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:32.243179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c844a-edd5-46aa-8fff-722f287ca903 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:32.243374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2186-770f-4679-a97f-b84d6e444367 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.243853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2186-770f-4679-a97f-b84d6e444367 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.244319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2186-770f-4679-a97f-b84d6e444367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.245910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2186-770f-4679-a97f-b84d6e444367 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:32.247343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2186-770f-4679-a97f-b84d6e444367 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:32.280751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748b337-4fe3-45fa-8c4b-8518368bde32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:32.281423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748b337-4fe3-45fa-8c4b-8518368bde32 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.281817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748b337-4fe3-45fa-8c4b-8518368bde32 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.282108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748b337-4fe3-45fa-8c4b-8518368bde32 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.282931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748b337-4fe3-45fa-8c4b-8518368bde32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:32.284438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748b337-4fe3-45fa-8c4b-8518368bde32 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:32.292295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 494/1001] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:32 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 09:56:32.335275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 508/1002] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:32.687205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee4ba-05e9-46d0-9b41-236376709993 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.687720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee4ba-05e9-46d0-9b41-236376709993 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.687818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eee4ba-05e9-46d0-9b41-236376709993 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.689284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 495/1003] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:32.695001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.695292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.695572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.713982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:32.715089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:32.778037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:32.791741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 509/1004] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:32.813469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee4ba-05e9-46d0-9b41-236376709993 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:32.840745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:32.919966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eee4ba-05e9-46d0-9b41-236376709993 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:32.954652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:32.955440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:32.955987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:32.956166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:32.956914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:32.958273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:32.970063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:32.971213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:32.972138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:32.976218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 496/1005] 10.222.0.44 () {56 vars in 1105 bytes} [Tue May 24 09:56:32 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:32.977284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:33.074107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89254-c72e-4962-acae-02043f2705e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:33.108140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:33.108801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:33.109081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:33.109354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:33.110053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:33.110356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:33.111721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cfdf8-5975-4ce2-bffb-f6fca8808b28 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:33.121803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 510/1006] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:33.123415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:33.216160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:33.229155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5869-e6fd-4f5e-ae2c-41dfb2849c53 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:33.262978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:33.263648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:33.263948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:33.264231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:33.264936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:33.265244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:33.266605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75f951-3a26-4b8c-8cf7-2280ee1ba142 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:33.280316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 497/1007] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:34.591978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b8a19-9488-4b9b-bb0f-1eb3d2bd937a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:34.592487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b8a19-9488-4b9b-bb0f-1eb3d2bd937a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:34.592564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b8a19-9488-4b9b-bb0f-1eb3d2bd937a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:34.594072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 511/1008] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:34.599509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:34.599967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:34.600141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:34.608398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf47f3-6d7a-4068-8f58-4825cdc6c398 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:34.608693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf47f3-6d7a-4068-8f58-4825cdc6c398 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:34.608977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf47f3-6d7a-4068-8f58-4825cdc6c398 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:34.610355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 512/1009] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:34.616022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa841c1-36df-4129-b871-426596e49097 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:34.616309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa841c1-36df-4129-b871-426596e49097 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:34.616586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa841c1-36df-4129-b871-426596e49097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:34.618287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:34.619471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:34.633540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3aa841c1-36df-4129-b871-426596e49097 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:34.634711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3aa841c1-36df-4129-b871-426596e49097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:34.685168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:34.695892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 498/1010] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:34.703581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 513/1011] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:34.719791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:34.727625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa841c1-36df-4129-b871-426596e49097 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:34.808086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:34.827656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1389b-9405-47b0-8304-f2be72916c31 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:34.831474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa841c1-36df-4129-b871-426596e49097 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:34.865666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:34.866478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:34.866618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:34.866844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:34.867120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:34.867285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:34.867537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:34.867771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:34.867973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:34.869117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:34.869500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:34.870542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:34.872192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 514/1012] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:34.878190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:34.882861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:34.883886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 24 09:56:34.884930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:34.887129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 499/1013] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:34.892976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:34.941251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:34.992806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa354-2a44-4aef-9462-7e210470f4a9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:35.001325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15653-d06c-4a13-b31d-942136c27d84 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:35.026695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745108-e603-4b93-a368-36646073c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:35.027359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745108-e603-4b93-a368-36646073c444 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.027648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745108-e603-4b93-a368-36646073c444 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.027962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f745108-e603-4b93-a368-36646073c444 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.028676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745108-e603-4b93-a368-36646073c444 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:35.030138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f745108-e603-4b93-a368-36646073c444 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:35.036574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:35.037246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.037531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.037810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.038521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:35.038829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:35.040339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:35.050965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 500/1014] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:35.052013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:35.064447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:35.122304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 515/1015] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:34 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:35.170081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347a258-854c-46f4-a4e1-a76ff8a5b18b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:35.208109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:35.208795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.209081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.209366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.210085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:35.210520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:35.211828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25c98c-d8b9-408a-8b7b-a1f77299bdb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:35.222035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 501/1016] 10.222.0.44 () {56 vars in 1112 bytes} [Tue May 24 09:56:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:35.231749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745108-e603-4b93-a368-36646073c444 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:35.336700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f745108-e603-4b93-a368-36646073c444 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:35.345649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:35.373466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a869f-545b-4682-b74b-70e1ec989377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:35.374118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a869f-545b-4682-b74b-70e1ec989377 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.374401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a869f-545b-4682-b74b-70e1ec989377 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.374679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a869f-545b-4682-b74b-70e1ec989377 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.375428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a869f-545b-4682-b74b-70e1ec989377 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:35.376863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a869f-545b-4682-b74b-70e1ec989377 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:35.453551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 516/1017] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:56:35.489488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9191b-c343-45f9-8796-4ecff2a9894c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.489837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9191b-c343-45f9-8796-4ecff2a9894c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.490156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9191b-c343-45f9-8796-4ecff2a9894c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.491893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 502/1018] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:35.498565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e72171-568b-4d8d-a125-5e278cae40a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.498856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e72171-568b-4d8d-a125-5e278cae40a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.499131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e72171-568b-4d8d-a125-5e278cae40a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.517222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-68e72171-568b-4d8d-a125-5e278cae40a2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:35.518457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-68e72171-568b-4d8d-a125-5e278cae40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:35.602087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 517/1019] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:35.626093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9191b-c343-45f9-8796-4ecff2a9894c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:35.711727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:35.740492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9191b-c343-45f9-8796-4ecff2a9894c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:35.775295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e489231-93aa-43ae-9cc3-e7ba2e831324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:35.776358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e489231-93aa-43ae-9cc3-e7ba2e831324 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:35.776865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e489231-93aa-43ae-9cc3-e7ba2e831324 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:35.777148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e489231-93aa-43ae-9cc3-e7ba2e831324 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:35.777889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e489231-93aa-43ae-9cc3-e7ba2e831324 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:35.779269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e489231-93aa-43ae-9cc3-e7ba2e831324 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:35.859967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 503/1020] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:56:35 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:37.413454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad716a-76b3-40a3-aa96-ed46c74a47a4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:37.413990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad716a-76b3-40a3-aa96-ed46c74a47a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:37.414071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad716a-76b3-40a3-aa96-ed46c74a47a4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:37.415378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 518/1021] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:37.421190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:37.421618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:37.421762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:37.439248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:37.440556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:37.516862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 504/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:37.542502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad716a-76b3-40a3-aa96-ed46c74a47a4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:37.636986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:37.650853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad716a-76b3-40a3-aa96-ed46c74a47a4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:37.685193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11157aa-771c-4d7e-8779-0ec7128bbba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:37.685911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11157aa-771c-4d7e-8779-0ec7128bbba3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:37.686194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11157aa-771c-4d7e-8779-0ec7128bbba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:37.686469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11157aa-771c-4d7e-8779-0ec7128bbba3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:37.687651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11157aa-771c-4d7e-8779-0ec7128bbba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:37.689125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11157aa-771c-4d7e-8779-0ec7128bbba3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:37.691543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 519/1023] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:37.697047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:37.760957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:37.793847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692601b4-5e42-421a-b39e-3543d0a90748 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:37.794406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692601b4-5e42-421a-b39e-3543d0a90748 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:37.794685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692601b4-5e42-421a-b39e-3543d0a90748 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:37.796361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 520/1024] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:37.801928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:37.802226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:37.802508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:37.803084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f6860-f514-4dd8-b65f-d3a436399a94 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:37.819230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:37.820456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:37.840377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b35ae-c0b6-46c3-9eb0-b926539add33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:37.841051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b35ae-c0b6-46c3-9eb0-b926539add33 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:37.841338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b35ae-c0b6-46c3-9eb0-b926539add33 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:37.841618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b35ae-c0b6-46c3-9eb0-b926539add33 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:37.842347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b35ae-c0b6-46c3-9eb0-b926539add33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:37.843825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b35ae-c0b6-46c3-9eb0-b926539add33 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:37.899306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 521/1025] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:37.922631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:37.945332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 505/1026] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:56:37 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:38.017472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.034862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7448e9-1824-4975-ab3b-2e8f3f690ff9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.058389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed361b30-d7bc-4241-a067-1ba5c6f8f699 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.058731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed361b30-d7bc-4241-a067-1ba5c6f8f699 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.058948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed361b30-d7bc-4241-a067-1ba5c6f8f699 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.060644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 506/1027] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:38.066629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.066915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.067192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.073731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.074567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.074851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.075123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.085797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:38.087027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:38.087568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:38.095490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:38.096695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:38.097752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 522/1028] 10.222.0.44 () {56 vars in 1120 bytes} [Tue May 24 09:56:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:38.104572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.175094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 507/1029] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:38.200959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.223777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a380df-49ee-4edc-86d5-fcc59b5648c2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.251136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.261640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.262303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.262584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.262855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.263728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:38.264071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.265454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.274739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 523/1030] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:38.280613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.292821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.314739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f4594-608b-4e70-a58b-750a6fe7681b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.354212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.355122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.355461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.355740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.356519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.357886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:38.370209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:38.371282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:38.372889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 508/1031] 10.222.0.44 () {56 vars in 1105 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:38.378001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.397077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1e6fb-821b-46d5-96cb-93e8f8954c04 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.433030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.433859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.434104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.434379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.446303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.447763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:38.466366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:38.467343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:38.468663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:38.468663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:38.468663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:38.468663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:38.471940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 524/1032] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:38.473314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.489390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f486c2-58aa-44e0-b153-6a8e7547f5d4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.500730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.528307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.528974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.529254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.529536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.530235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:38.530539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.531924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.537281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 509/1033] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:38.542706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.543784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.586366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991fc9-1d82-49d6-83e2-a5242851e19f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.626017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.627008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.628238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.628687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.629575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:38.637017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.637017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.645693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 525/1034] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:38.650780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.656125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb384b-7f7b-4c07-b6d0-9b2edb1c98cc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.730616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.731197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.731488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.731766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.732504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:38.732817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.734182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.744257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 510/1035] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:38.745532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.786922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.802935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357d12-33b3-4dd2-9169-b289f41f2164 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.825228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:38.840214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.841132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.841417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.841696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.849594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.851491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.854285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b536-88f4-4b41-9bde-7394aff86461 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:38.867827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:38.868882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:38.870066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:38.872024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 526/1036] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:38.877666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.897522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:38.898102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:38.898389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:38.898721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:38.899451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] RBAC: Adding query filter params (interface=public, service_id=ae77cbd476fd4c29a1423a0911f7da86, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:38.899786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:38.901229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:38.906447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 511/1037] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/endpoints?service_id=ae77cbd476fd4c29a1423a0911f7da86&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:38.911869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:38.982196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07256-25bf-4520-b29c-69bd3de9cdb1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:39.019465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:39.020160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:39.020449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:39.020732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:39.021554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:39.021656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976782e3-1f0c-44f3-89cd-aef635809aec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:39.021864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:39.023308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:39.023534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:39.042079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 527/1038] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:39.047339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:39.057754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:39.058523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:39.059023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:39.059465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:39.060303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:39.061888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:39.069162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 512/1039] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:56:38 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:56:39.106910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:39.177051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13b52-daf0-48b5-8a19-ae26afc274d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:39.216030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:39.216701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:39.216987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:39.217329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:39.288711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:39.290119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:39.328968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:39.393601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 528/1040] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:39.394781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:39.505465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3ef4-92a4-40a4-8bfe-7ab27c419d62 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:39.539854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:39.540556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:39.540841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:39.541119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:39.552132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:39.553662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:39.571708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:39.573071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:39.574320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:39.574320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:39.574320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:39.574320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:39.574320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 513/1041] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:39.579839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:39.679310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a452b65-a0e8-4bf7-9dae-6c0492a8b1b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:39.713168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:39.713834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:39.714121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:39.714400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:39.715124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:39.715434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:39.716848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:39.724508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:39.734648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 529/1042] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:39.736057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:39.756782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:39.838755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886801b1-30f8-436d-b94a-1ac542b9500d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:39.872652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:39.873446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:39.873728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:39.874002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:39.880973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:39.882448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:39.896685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:39.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:39.898538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:39.899589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 514/1043] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:39.903674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:40.009487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b4bb3-c450-4223-b316-2bc1644e0d31 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:40.043336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:40.044021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.044309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.044587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.045364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:40.045678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:40.047113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c103b6-fef3-4810-b25f-8c0bbbdeef79 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:40.064006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 530/1044] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:40.066304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:40.150973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:40.172973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336566ff-b743-463b-bb9a-445f27ae48ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:40.209246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:40.209909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.210186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.210469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.211300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] RBAC: Adding query filter params (role.id=d089f095fa064fbe915d715b6614613c, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6dc6411c631a41d5a22ee51adca2b8f1) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:40.211627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:40.213106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24167763-0d39-4d59-9c7a-0d93e4675337 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:40.219007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 515/1045] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:40 2022] GET /identity/v3/role_assignments?user.id=6dc6411c631a41d5a22ee51adca2b8f1&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=d089f095fa064fbe915d715b6614613c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:40.265358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11d5e-cb78-4233-acb9-788c0dd0efc3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.265680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11d5e-cb78-4233-acb9-788c0dd0efc3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.265926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b11d5e-cb78-4233-acb9-788c0dd0efc3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.267458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 531/1046] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:40.273196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.273482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.273762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.294216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:40.295432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:40.369159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 516/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:40.393506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b11d5e-cb78-4233-acb9-788c0dd0efc3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:40.459656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:40.502709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b11d5e-cb78-4233-acb9-788c0dd0efc3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:40.537768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:40.538563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.538849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.539127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.549531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:40.557300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:40.558255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:40.559135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 532/1048] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:40.564512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:40.634386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:40.664723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402183f-525d-4d62-a6f5-9e3276c8ac48 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:40.701742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:40.701742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.701742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.701742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.702361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:40.702671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:40.704062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:40.713565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 517/1049] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:40.719245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:40.820572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65caf360-5932-4c66-b40f-7f08b734f7a8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:40.838021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:40.854759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:40.855638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:40.855946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:40.856218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] PATH_INFO: `/v3/users/10c04a0c8d4f413bbe122736a33413e1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:40.870358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] RBAC: Authorizing `identity:get_user(user_id=10c04a0c8d4f413bbe122736a33413e1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:40.872183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:40.874048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 533/1050] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:40 2022] GET /identity/v3/users/10c04a0c8d4f413bbe122736a33413e1 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:40.880382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:40.984352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93b8df-30ee-450e-87c8-3e62fc08770c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:41.018862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26960c6-4e94-4297-a825-1eb775b93c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:41.019516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26960c6-4e94-4297-a825-1eb775b93c95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.019824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26960c6-4e94-4297-a825-1eb775b93c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.020095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26960c6-4e94-4297-a825-1eb775b93c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.022798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:41.088607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26960c6-4e94-4297-a825-1eb775b93c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:41.090104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26960c6-4e94-4297-a825-1eb775b93c95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:41.197089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 518/1051] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:56:41.199178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:41.297937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4e47d-c73c-47b0-a117-bf717f0c7656 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.298132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4e47d-c73c-47b0-a117-bf717f0c7656 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.298405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4e47d-c73c-47b0-a117-bf717f0c7656 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.299728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cd8e-25c0-4842-8d63-8568d39d150e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:41.300833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 519/1052] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:41.305682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.305978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.306260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.324953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:41.326149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:41.343021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:41.344166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.344911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.345184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.346398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] RBAC: Authorizing `identity:get_project(project_id=2f2179e2d7bc4ad999026fafd121ac8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:41.348487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:41.351599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 534/1053] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:56:41 2022] GET /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:41.357093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:41.359377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:41.403768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 520/1054] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:41.410742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:41.427350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:41.471716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36508b8-52c8-4aa4-a1ec-70c5847a528f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:41.510121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:41.510771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.511055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.511331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.512545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b, user.id=10c04a0c8d4f413bbe122736a33413e1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:41.512545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:41.513969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:41.531825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 535/1055] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:41 2022] GET /identity/v3/role_assignments?user.id=10c04a0c8d4f413bbe122736a33413e1&scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:41.539908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df237fb-0bd5-4494-9473-ba90800249ca None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:41.584433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:41.585264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.585541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.585818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.586499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:41.587976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:41.601198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:41.602345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:41.603222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 521/1056] 10.222.0.44 () {56 vars in 1105 bytes} [Tue May 24 09:56:41 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:41.608687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:41.722728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec5742-c962-4a7e-ad99-4720d87f9047 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:41.732502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:41.759896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:41.760565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.760849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.761125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.761855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:41.762163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:41.763543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:41.769344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 536/1057] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:41.774780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:41.803853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:41.876316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140932b-e8fa-4d9e-a11a-194680b83d95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:41.912124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:41.912793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:41.913078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:41.913355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:41.914081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:41.914361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:41.915720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4249-f1e4-4497-84e2-da4cd71351b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:41.925866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 522/1058] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:41.927512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:42.032851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b6fac-8203-47fd-98f5-cb75e226aff8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:42.066387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769bbf1-8c67-4300-b248-ad99866360d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:42.067044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769bbf1-8c67-4300-b248-ad99866360d2 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:42.067324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769bbf1-8c67-4300-b248-ad99866360d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:42.067597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769bbf1-8c67-4300-b248-ad99866360d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:42.068379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769bbf1-8c67-4300-b248-ad99866360d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:42.069757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769bbf1-8c67-4300-b248-ad99866360d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:42.151632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 537/1059] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:56:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:42.432599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193916-5048-4646-a3e9-9666737f22de None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:42.432898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193916-5048-4646-a3e9-9666737f22de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:42.433116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193916-5048-4646-a3e9-9666737f22de None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:42.434818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 523/1060] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:42.440348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:42.440645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:42.440924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:42.460125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:42.461326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:42.485246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:42.535226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 538/1061] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:42.557673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193916-5048-4646-a3e9-9666737f22de None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:42.652538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:42.664168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193916-5048-4646-a3e9-9666737f22de None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:42.701168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:42.701902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:42.702184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:42.702462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:42.713331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:42.722313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:42.723337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:42.724853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:42.727870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 524/1062] 10.222.0.44 () {56 vars in 1120 bytes} [Tue May 24 09:56:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:42.729621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:42.829268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb79f6-4ac5-4817-b736-e8a838d97d7d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:42.863398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:42.864089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:42.864373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:42.864647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:42.865392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:42.865699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:42.867071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:42.875393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 539/1063] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:56:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:42.880963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:42.985827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e50a9-bb30-4f5e-92f0-1a92b1d27849 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:43.019222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:43.020166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.020452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.020728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.031203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:43.032683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:43.050945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:43.051934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:43.057818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:43.057818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:43.057818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:43.057818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:43.057818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 525/1064] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:43.059300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.078486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:43.159358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc5335-afc8-4feb-9494-95ff7415d266 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:43.193915 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:43.194573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.194857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.195135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.195880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:43.196192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:43.197569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:43.213870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 540/1065] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:43.215944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.221325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:43.322046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb4ed-66d4-4e84-9f41-0adcb7c69755 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:43.356604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:43.357399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.357681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.357952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.366512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:43.367999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:43.382150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:43.383112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:43.384114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:43.387880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 526/1066] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:43.389394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.470531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:43.494255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f962315-c53d-4560-a5b9-d4f6dfef58e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:43.527788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:43.528476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.528762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.529036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.529871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:43.530295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:43.531733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:43.554848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 541/1067] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:43.557217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.624787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:43.663674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e26e4-42dd-417f-93c7-40e76fd54af0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:43.697405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:43.698450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.698730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.699001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.710757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:43.712229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2dd29b67-bedd-44fb-a7c8-772ed6c5382e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:43.729269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:43.730218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:43.731131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:43.731131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:43.731131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:43.731131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:43.732151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 527/1068] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:43.736262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.749443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea0c9-1aa7-4037-901b-be546dc28a67 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.749763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea0c9-1aa7-4037-901b-be546dc28a67 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.750017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ea0c9-1aa7-4037-901b-be546dc28a67 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.751528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 528/1069] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:43.756877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.757175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.757453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.775155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:43.776369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:43.849813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4eca-ceb8-4d7e-a3b3-afd111a7a8a2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:43.852317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 529/1070] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:43.874984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.888694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:43.889362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:43.889692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:43.889982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:43.890682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:43.891180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:43.892474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:43.894756 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:43.905126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 542/1071] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:43.910694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:43.928114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:43.989732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62020-9c0f-4598-b573-7ec77c793fd1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.026506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.027478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.027859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.028207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.031874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e84d-3a66-4af6-a8b2-3a9a8e6472a6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.039566 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:44.047235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:44.048393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:44.049915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 530/1072] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:44.054882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.073329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.074204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.074559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.074906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.082540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.084118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:44.102476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:44.103622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:44.104791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:44.106443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 543/1073] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:44.111829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.166280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19392b6-a97e-45e1-ba67-039039c924b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.169455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:44.174408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:44.204874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.206133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.206414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.206867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.207535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:44.207867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.209332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.223316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 531/1074] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:44.224414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.227657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d08259-2679-4058-bd4f-9879ab906141 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.262927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.263706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.264084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.264439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.265295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:44.265678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.267202 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.280587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 544/1075] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:44.286818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.332730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e692c-7bd8-420a-9f91-4311c624c7c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.370518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79464b68-1759-4dc8-bd08-e2954ef14dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.371647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464b68-1759-4dc8-bd08-e2954ef14dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.372439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464b68-1759-4dc8-bd08-e2954ef14dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.372874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79464b68-1759-4dc8-bd08-e2954ef14dc3 None admin] PATH_INFO: `/v3/users/10c04a0c8d4f413bbe122736a33413e1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.374378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79464b68-1759-4dc8-bd08-e2954ef14dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=10c04a0c8d4f413bbe122736a33413e1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.375832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79464b68-1759-4dc8-bd08-e2954ef14dc3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.378049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 532/1076] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:44 2022] GET /identity/v3/users/10c04a0c8d4f413bbe122736a33413e1 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:44.383812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746eff2-c5c8-4c2f-ae55-013f5f77e1a7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.384111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746eff2-c5c8-4c2f-ae55-013f5f77e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.384393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746eff2-c5c8-4c2f-ae55-013f5f77e1a7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.385638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 533/1077] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:44.386338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746eff2-c5c8-4c2f-ae55-013f5f77e1a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.398053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc496021-f1da-415e-8296-16601db41eaf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.413456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:44.427720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:44.433313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f011309-fbef-4573-835c-6d8a49c1172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.434204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011309-fbef-4573-835c-6d8a49c1172c None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.434528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011309-fbef-4573-835c-6d8a49c1172c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.434808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f011309-fbef-4573-835c-6d8a49c1172c None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6dc6411c631a41d5a22ee51adca2b8f1/roles/d089f095fa064fbe915d715b6614613c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.437027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f011309-fbef-4573-835c-6d8a49c1172c None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=6dc6411c631a41d5a22ee51adca2b8f1, role_id=d089f095fa064fbe915d715b6614613c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.438466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f011309-fbef-4573-835c-6d8a49c1172c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.487373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 545/1078] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:44 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6dc6411c631a41d5a22ee51adca2b8f1/roles/d089f095fa064fbe915d715b6614613c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 09:56:44.488448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.488740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.489019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.496778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746eff2-c5c8-4c2f-ae55-013f5f77e1a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.513523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:44.514759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:44.538310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.539207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.539570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.539895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.541115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] RBAC: Authorizing `identity:get_project(project_id=2f2179e2d7bc4ad999026fafd121ac8b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.542692 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.544955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 534/1079] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:56:44 2022] GET /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:44.551024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.597445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 546/1080] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:44.619985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:44.665254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a79cf-538c-4766-8e0c-f2b25fb58916 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.667944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:44.704180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.705393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.705508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.705726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b/users/10c04a0c8d4f413bbe122736a33413e1/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.707735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f2179e2d7bc4ad999026fafd121ac8b, user_id=10c04a0c8d4f413bbe122736a33413e1, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.709207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.740393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8e61-b135-415f-98d2-c5430d0135c5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:44.743504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:44.774602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:44.775253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:44.775539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:44.775843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:44.784602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 535/1081] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:44 2022] PUT /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b/users/10c04a0c8d4f413bbe122736a33413e1/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:56:44.853051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:44.854578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:44.963548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 547/1082] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:56:44.968400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:45.075629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f1e4c-6121-4358-ae32-75b8188e7c32 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:45.110503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:45.112159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:45.112159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:45.112488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:45.122592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:45.124068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cfba54fd-55c3-4df8-8170-15c18cffc91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:45.141828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:45.143267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:45.149215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:45.149215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:45.149215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:45.149215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:45.149215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 536/1083] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:45.150925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:45.154329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:45.253968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96efb2d-232d-489d-9be1-9cb7b566eaad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:45.289285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:45.290046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:45.290404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:45.290750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:45.291547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:45.291954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:45.293396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e8918-538e-44b5-a71b-213eb0448f7c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:45.311895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 548/1084] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:46.691509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c48b-bbcc-48a6-95e3-ec56f6a8b7d9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:46.692086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c48b-bbcc-48a6-95e3-ec56f6a8b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:46.692086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c48b-bbcc-48a6-95e3-ec56f6a8b7d9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:46.693474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 537/1085] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:46.699019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774004eb-39fa-4c5e-977e-fcc65b0391cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:46.699418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774004eb-39fa-4c5e-977e-fcc65b0391cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:46.699532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774004eb-39fa-4c5e-977e-fcc65b0391cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:46.716547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-774004eb-39fa-4c5e-977e-fcc65b0391cc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:46.717731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-774004eb-39fa-4c5e-977e-fcc65b0391cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:46.775776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:46.785566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 549/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:46.810415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c48b-bbcc-48a6-95e3-ec56f6a8b7d9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:46.828486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:46.913474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c48b-bbcc-48a6-95e3-ec56f6a8b7d9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:46.956354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:46.957439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:46.957868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:46.958286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:46.969047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b01e8-7e67-418f-81d5-976cd61cd785 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:46.969333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b01e8-7e67-418f-81d5-976cd61cd785 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:46.969791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b01e8-7e67-418f-81d5-976cd61cd785 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:46.971778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 550/1087] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 09:56:46.973928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:46.976842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:46.977129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:46.977411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:46.982328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:46.983291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:46.984357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 538/1088] 10.222.0.44 () {56 vars in 1120 bytes} [Tue May 24 09:56:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:46.990041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:46.994896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:46.996120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:47.061105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 551/1089] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:47.066593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.084580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.089659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd5432-34e8-4944-bf99-96211679994a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.123384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.124083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.124364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.124648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.125419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:47.125727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.127127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.135735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 539/1090] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:56:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:47.141233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.180649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac335d7-6256-47b7-a762-c3850c29d08e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.204077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.217150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.217150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.217150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.217150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.225904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:56:47.233627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:47.234603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:56:47.241190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 552/1091] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:47.241896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.242261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4182a60-ed03-4c6d-acbf-2b05142c811e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.275435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.276250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.276531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.276802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.284265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.288102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.289547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:47.306791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:47.307735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:47.308686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:47.308686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:47.308686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:47.308686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:47.308686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 540/1092] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:47.313629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.343701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480bbcd-4f0a-4cf6-94c5-27f5dbc05e4e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.376873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.377523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.377800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.378070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.378803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:47.379105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.380509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.388377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 553/1093] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:47.394496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.411729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0be03-176c-40f5-879c-4148a6ea8651 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.438921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.446260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.447004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.447272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.447548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.448554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:47.455610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.455610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.462642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 541/1094] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:47.468289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.493606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908fd01-81de-4fc0-827a-bed91ffa7a39 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.516834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.527270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.528174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.528465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.528738 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] PATH_INFO: `/v3/users/10c04a0c8d4f413bbe122736a33413e1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.529924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] RBAC: Authorizing `identity:get_user(user_id=10c04a0c8d4f413bbe122736a33413e1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.531477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.533916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 554/1095] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/users/10c04a0c8d4f413bbe122736a33413e1 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:47.539511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.566905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4f0cd-4f8e-46d8-84d2-b5ca1a0d00ae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.603144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.604034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.604324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.604600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.612405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.613971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:56:47.629130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:47.630154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:47.631226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 542/1096] 10.222.0.44 () {56 vars in 1093 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:47.636042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.639104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52212db0-7829-48f1-b3f0-6c6e655f308c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.653608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.674773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.675524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.675836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.676129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.734796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1338b9-fbe7-4d21-98f3-f0be2e5708ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.741671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.743196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.745617 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.769510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.770188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.770667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.771111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.772253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:47.772562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.773980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.791253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 543/1097] 10.222.0.44 () {56 vars in 1133 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:47.796901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.845505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 555/1098] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:56:47.851230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:47.865494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.900741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334ae3-9e7d-48d4-8a0d-8fa091f45438 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.934119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.934764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.935051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.935330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.953405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff5af-7e35-403f-a8c2-a552160c14b7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:47.978160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:47.988786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:47.989656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:47.990008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:47.990294 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:47.991454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] RBAC: Authorizing `identity:get_project(project_id=2f2179e2d7bc4ad999026fafd121ac8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:47.992934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:47.994671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 556/1099] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:48.000659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:48.010086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.011528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.080794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:48.098481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c0a6a-ba78-4dc2-a374-8b550bf46110 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:48.109249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 544/1100] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 24 09:56:48.114825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:48.133281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:48.133921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:48.134201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:48.134476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:48.135287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b, user.id=10c04a0c8d4f413bbe122736a33413e1) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:48.135597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.137063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.155843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 557/1101] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:47 2022] GET /identity/v3/role_assignments?user.id=10c04a0c8d4f413bbe122736a33413e1&scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:48.182917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:48.217950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf068c2-92cd-493c-a4c1-2ecb25c53c89 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:48.257026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:48.257747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:48.258032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:48.258309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:48.269585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.271057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:56:48.290548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:48.291701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:48.292803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:56:48.292803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:56:48.292803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:56:48.292803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:48.292803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 545/1102] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:56:48.297694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:48.401292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa55ac-7638-4cbd-b601-5413fcdd2579 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:48.433163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:48.433813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:48.434091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:48.434363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:48.435079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:48.435382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.436789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.450364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 558/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:48.456522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:48.555891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd514d72-7972-4a6c-88b2-dc99d0f01b83 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:48.576377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:48.590032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:48.595201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:48.595201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:48.595201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:48.598075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.599523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:56:48.614779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:56:48.615756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:56:48.616740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:56:48.621001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 546/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:56:48.621771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:48.630824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:48.718563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf5599-73f3-4972-b754-2719ac03e474 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:48.751335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:48.752125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:48.752409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:48.752682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:48.753455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:48.753759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.755206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3172f-5ee9-4334-b96a-7c7d5fd7b660 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.766358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 559/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:48.772843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:48.870699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055e335-b017-484b-95a9-135f188a78ff None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:48.903895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:48.904545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:48.904826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:48.905099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:48.905917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] RBAC: Adding query filter params (role.id=d089f095fa064fbe915d715b6614613c, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6dc6411c631a41d5a22ee51adca2b8f1) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:48.906224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:48.907638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce1c37-0223-4fee-b06b-f10783b06cb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:48.914097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 547/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:48 2022] GET /identity/v3/role_assignments?user.id=6dc6411c631a41d5a22ee51adca2b8f1&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=d089f095fa064fbe915d715b6614613c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:56:50.380916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd18a4-8ea7-4388-97f3-146d0ef447ae None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:50.381538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd18a4-8ea7-4388-97f3-146d0ef447ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:50.381538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd18a4-8ea7-4388-97f3-146d0ef447ae None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:50.382826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 560/1107] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:50.388065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:50.388461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:50.388634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:50.405768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:50.406927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:50.446321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:50.472444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 548/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:50.496530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd18a4-8ea7-4388-97f3-146d0ef447ae None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:50.560060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:50.599999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd18a4-8ea7-4388-97f3-146d0ef447ae None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:50.632121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a643c-8217-49ec-8ebc-99cdb2d5d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:50.632859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a643c-8217-49ec-8ebc-99cdb2d5d2fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:50.633143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a643c-8217-49ec-8ebc-99cdb2d5d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:50.633417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a643c-8217-49ec-8ebc-99cdb2d5d2fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:50.634589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a643c-8217-49ec-8ebc-99cdb2d5d2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:50.636053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a643c-8217-49ec-8ebc-99cdb2d5d2fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:50.637649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 561/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:56:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:50.644303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:50.739960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e173d6f-c942-4a57-8200-c889b90c6fc1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:50.773385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ad736-627e-45ff-9e3f-55ce760eba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:50.774040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad736-627e-45ff-9e3f-55ce760eba95 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:50.774327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad736-627e-45ff-9e3f-55ce760eba95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:50.774608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ad736-627e-45ff-9e3f-55ce760eba95 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:50.775312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ad736-627e-45ff-9e3f-55ce760eba95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:50.776921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ad736-627e-45ff-9e3f-55ce760eba95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:50.881966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 549/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:56:50 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:56:53.092696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89fcf-95ec-428c-9128-b763c34a84b1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:53.093244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89fcf-95ec-428c-9128-b763c34a84b1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:53.093244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d89fcf-95ec-428c-9128-b763c34a84b1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:53.094603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 562/1111] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:53.100520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:53.100933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:53.101087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:53.117621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:53.118832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:53.141506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:53.184334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 550/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:53.209443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89fcf-95ec-428c-9128-b763c34a84b1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:53.308394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d89fcf-95ec-428c-9128-b763c34a84b1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:53.341452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:53.342292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:53.342574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:53.342896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] PATH_INFO: `/v3/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:53.344319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] RBAC: Authorizing `identity:get_role(role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:53.346437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:53.347773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 563/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:53 2022] GET /identity/v3/roles/d8c3658111d243bf9e85b889e49a811e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:53.353486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:53.449560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0a836-9fb6-42ed-a6e8-fe35c074c8fa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:53.482568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:53.483431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:53.483716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:53.484014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] PATH_INFO: `/v3/users/a3b11bef54564be99afbcb816c75eb9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:53.496749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] RBAC: Authorizing `identity:get_user(user_id=a3b11bef54564be99afbcb816c75eb9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:53.498196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:53.499843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 551/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:53 2022] GET /identity/v3/users/a3b11bef54564be99afbcb816c75eb9a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:53.506073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:53.508938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:53.602469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0db54-c9fb-480c-8c5d-49d2326b57d1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:53.634417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:53.635046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:53.635328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:53.635602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:53.699575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:53.701054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:53.702767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:53.795418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 564/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:53.801843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:53.820146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:53.900016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67315a-cb2f-49d6-bd46-01c9628b749b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:53.932829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804dbe2-b1ef-4a8f-b822-1ecd9cb28679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:53.933775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804dbe2-b1ef-4a8f-b822-1ecd9cb28679 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:53.934061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804dbe2-b1ef-4a8f-b822-1ecd9cb28679 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:53.934334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804dbe2-b1ef-4a8f-b822-1ecd9cb28679 None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:53.935486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804dbe2-b1ef-4a8f-b822-1ecd9cb28679 None admin] RBAC: Authorizing `identity:get_project(project_id=2f2179e2d7bc4ad999026fafd121ac8b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:53.936938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804dbe2-b1ef-4a8f-b822-1ecd9cb28679 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:53.938616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 552/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:56:53 2022] GET /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:53.944639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:54.040180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e155bd-5798-4312-b2a0-61c10d63e70a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:54.041683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:54.072457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:54.073382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:54.073662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:54.073938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:54.074756 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] RBAC: Adding query filter params (role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b, user.id=a3b11bef54564be99afbcb816c75eb9a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:56:54.075067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:54.076553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee4f4-a617-4571-bb89-9e1b1431c08e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:54.082804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 565/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:53 2022] GET /identity/v3/role_assignments?user.id=a3b11bef54564be99afbcb816c75eb9a&scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b&role.id=d8c3658111d243bf9e85b889e49a811e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:56.238962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825254ad-ebdf-4589-bba9-a22a9b3fc085 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:56.239489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825254ad-ebdf-4589-bba9-a22a9b3fc085 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:56.239489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825254ad-ebdf-4589-bba9-a22a9b3fc085 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:56.240901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 553/1118] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:56.246253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:56.246679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:56.246817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:56.263207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:56.264432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:56.329425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 566/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:56:56.352462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825254ad-ebdf-4589-bba9-a22a9b3fc085 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:56.435121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:56.451101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825254ad-ebdf-4589-bba9-a22a9b3fc085 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:56.484524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:56.485373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:56.485657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:56.485959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] PATH_INFO: `/v3/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:56.487476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] RBAC: Authorizing `identity:get_role(role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:56.488884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:56.490295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 554/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:56 2022] GET /identity/v3/roles/d8c3658111d243bf9e85b889e49a811e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:56.496072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:56.586969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:56.592573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e408de-f034-4edc-a6db-5d90753be32b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:56.624676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:56.625539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:56.625821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:56.626093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] PATH_INFO: `/v3/users/a3b11bef54564be99afbcb816c75eb9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:56.627890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] RBAC: Authorizing `identity:get_user(user_id=a3b11bef54564be99afbcb816c75eb9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:56.629329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:56.630926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 567/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:56 2022] GET /identity/v3/users/a3b11bef54564be99afbcb816c75eb9a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:56.636544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:56.732715 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8972f-c085-4dcc-a549-94d12c648264 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:56.765078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04040a7-c534-49ae-96e8-f4c6efc8abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:56.765855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04040a7-c534-49ae-96e8-f4c6efc8abd8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:56.766134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04040a7-c534-49ae-96e8-f4c6efc8abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:56.766406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04040a7-c534-49ae-96e8-f4c6efc8abd8 None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:56.768168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04040a7-c534-49ae-96e8-f4c6efc8abd8 None admin] RBAC: Authorizing `identity:get_project(project_id=2f2179e2d7bc4ad999026fafd121ac8b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:56.769576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04040a7-c534-49ae-96e8-f4c6efc8abd8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:56.771228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 555/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:56:56 2022] GET /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:56.776840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:56.872454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46373491-f22c-4899-8ce0-72c3bf932335 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:56.905032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917e576-11ea-4776-a6ef-7b01988d3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:56.905897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917e576-11ea-4776-a6ef-7b01988d3781 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:56.906180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917e576-11ea-4776-a6ef-7b01988d3781 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:56.906453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917e576-11ea-4776-a6ef-7b01988d3781 None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b/users/a3b11bef54564be99afbcb816c75eb9a/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:56.908694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917e576-11ea-4776-a6ef-7b01988d3781 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f2179e2d7bc4ad999026fafd121ac8b, user_id=a3b11bef54564be99afbcb816c75eb9a, role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:56.910127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917e576-11ea-4776-a6ef-7b01988d3781 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:56.977708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 568/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:56:56 2022] PUT /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b/users/a3b11bef54564be99afbcb816c75eb9a/roles/d8c3658111d243bf9e85b889e49a811e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:56:59.136657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54104c1-df0e-4794-997b-7ea583b32193 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:59.137203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54104c1-df0e-4794-997b-7ea583b32193 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:59.137203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54104c1-df0e-4794-997b-7ea583b32193 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:59.138565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 556/1124] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:56:59.143774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:59.144243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:59.144347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:59.160795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:56:59.161971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:56:59.179193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:59.228057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 569/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:56:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:56:59.252077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54104c1-df0e-4794-997b-7ea583b32193 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:59.275732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:59.352941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54104c1-df0e-4794-997b-7ea583b32193 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:59.385894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:59.400485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:59.400485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:59.400485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] PATH_INFO: `/v3/roles/d8c3658111d243bf9e85b889e49a811e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:59.400485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] RBAC: Authorizing `identity:get_role(role_id=d8c3658111d243bf9e85b889e49a811e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:59.400485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:59.400485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 557/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:59 2022] GET /identity/v3/roles/d8c3658111d243bf9e85b889e49a811e => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:59.401127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:59.498984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac756ea-05ed-4b2b-9819-03ed93f3ad1e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:59.531218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:59.532104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:59.532385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:59.533347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] PATH_INFO: `/v3/users/a3b11bef54564be99afbcb816c75eb9a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:59.534641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] RBAC: Authorizing `identity:get_user(user_id=a3b11bef54564be99afbcb816c75eb9a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:59.536106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:59.537733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 570/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:56:59 2022] GET /identity/v3/users/a3b11bef54564be99afbcb816c75eb9a => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:59.543471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:59.632471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:59.641679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613146f7-3b31-4f00-9207-2fd975bf6cd0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:59.675351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:59.675964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:59.676251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:59.676529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:59.740712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:59.742150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:59.826170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:59.836422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 558/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:56:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:56:59.842275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:56:59.866860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:56:59.938983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2550e-f9f3-4613-940d-41b189957ecb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:56:59.971806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df4a5a-0b4c-40bc-9563-e0f537c1c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:56:59.972673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4a5a-0b4c-40bc-9563-e0f537c1c65c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:56:59.972952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4a5a-0b4c-40bc-9563-e0f537c1c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:56:59.973223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df4a5a-0b4c-40bc-9563-e0f537c1c65c None admin] PATH_INFO: `/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:56:59.974381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df4a5a-0b4c-40bc-9563-e0f537c1c65c None admin] RBAC: Authorizing `identity:get_project(project_id=2f2179e2d7bc4ad999026fafd121ac8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:56:59.975830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df4a5a-0b4c-40bc-9563-e0f537c1c65c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:56:59.977485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 571/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:56:59 2022] GET /identity/v3/projects/2f2179e2d7bc4ad999026fafd121ac8b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:56:59.983398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:00.078004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c162-8965-457e-afc6-f19bfc1c0a33 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:00.111221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:00.111898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:00.112182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:00.112455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:00.113271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] RBAC: Adding query filter params (role.id=d8c3658111d243bf9e85b889e49a811e, scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b, user.id=a3b11bef54564be99afbcb816c75eb9a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:00.113581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:00.114994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa930637-7992-4092-a942-c64ba445db92 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:00.120725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 559/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:56:59 2022] GET /identity/v3/role_assignments?user.id=a3b11bef54564be99afbcb816c75eb9a&scope.project.id=2f2179e2d7bc4ad999026fafd121ac8b&role.id=d8c3658111d243bf9e85b889e49a811e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:02.301386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a716b0-0d64-4378-bc81-2a6364e41692 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:02.301922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a716b0-0d64-4378-bc81-2a6364e41692 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:02.301922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a716b0-0d64-4378-bc81-2a6364e41692 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:02.303285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 572/1131] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:02.308664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:02.309073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:02.309214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:02.326307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:02.327468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:02.374043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:02.390331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 560/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:57:02.414337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a716b0-0d64-4378-bc81-2a6364e41692 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:02.502216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:02.512263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a716b0-0d64-4378-bc81-2a6364e41692 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:02.546400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e1ba3-0d9e-42bd-ab8a-8f8333662899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:02.547173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1ba3-0d9e-42bd-ab8a-8f8333662899 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:02.547451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1ba3-0d9e-42bd-ab8a-8f8333662899 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:02.547724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1ba3-0d9e-42bd-ab8a-8f8333662899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:02.549205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e1ba3-0d9e-42bd-ab8a-8f8333662899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:02.550648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e1ba3-0d9e-42bd-ab8a-8f8333662899 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:02.552382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 573/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:57:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:02.558113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:02.654698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7acb-5f10-4dbd-973c-e6a917812394 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:02.686619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb39d00-dfc0-4aae-a8fa-911e57e05ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:02.687267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39d00-dfc0-4aae-a8fa-911e57e05ade None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:02.687551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39d00-dfc0-4aae-a8fa-911e57e05ade None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:02.687852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb39d00-dfc0-4aae-a8fa-911e57e05ade None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:02.688550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb39d00-dfc0-4aae-a8fa-911e57e05ade None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:02.690471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb39d00-dfc0-4aae-a8fa-911e57e05ade None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:02.773185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 561/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:57:02 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:57:04.972885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bfe4d-6af7-475e-b13e-24935be51448 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:04.973419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bfe4d-6af7-475e-b13e-24935be51448 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:04.973419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bfe4d-6af7-475e-b13e-24935be51448 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:04.974769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 574/1135] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:04.979927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:04.980339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:04.980489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:04.997533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:04.998709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:05.026110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:05.063922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 562/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:05.089691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bfe4d-6af7-475e-b13e-24935be51448 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:05.187350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bfe4d-6af7-475e-b13e-24935be51448 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:05.220055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5507ea-56b8-496b-a8ce-8fbb13b79e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:05.220822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5507ea-56b8-496b-a8ce-8fbb13b79e3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:05.221101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5507ea-56b8-496b-a8ce-8fbb13b79e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:05.221370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5507ea-56b8-496b-a8ce-8fbb13b79e3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:05.222518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5507ea-56b8-496b-a8ce-8fbb13b79e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:05.224015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5507ea-56b8-496b-a8ce-8fbb13b79e3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:05.225523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 575/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:57:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:05.231223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:05.328270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cbd8b-df0d-4d22-9b5d-028edd0199b2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:05.360304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef57c5-fbdb-4ba1-9af9-df166f1fc2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:05.361475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef57c5-fbdb-4ba1-9af9-df166f1fc2df None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:05.361755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef57c5-fbdb-4ba1-9af9-df166f1fc2df None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:05.362030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef57c5-fbdb-4ba1-9af9-df166f1fc2df None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:05.362740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef57c5-fbdb-4ba1-9af9-df166f1fc2df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:05.364191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef57c5-fbdb-4ba1-9af9-df166f1fc2df None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:05.433496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 563/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:57:05 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 09:57:07.653262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ecf0f-a58c-4e5c-a2bd-b797b600adbb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:07.653863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ecf0f-a58c-4e5c-a2bd-b797b600adbb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:07.653863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ecf0f-a58c-4e5c-a2bd-b797b600adbb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:07.655164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 576/1139] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:07.660830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:07.661226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:07.661386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:07.678532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:07.679708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:07.696191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:07.745750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 564/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:07.768910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ecf0f-a58c-4e5c-a2bd-b797b600adbb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:07.795598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:07.866624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ecf0f-a58c-4e5c-a2bd-b797b600adbb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:07.898479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:07.899255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:07.899536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:07.899831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:07.909986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:57:07.917600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:07.918791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:57:07.919983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 577/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:57:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 24 09:57:07.925523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:08.021086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08861229-1d50-4347-b9b1-faecc8beb42d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:08.054294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:08.054949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:08.055233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:08.055506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:08.056282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:08.056588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:08.057946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:08.065873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 565/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:08.071441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:08.154132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:08.168410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88106e-4359-4608-a8cd-2fcfdc8c3a14 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:08.201902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:08.202757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:08.203037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:08.203312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] PATH_INFO: `/v3/users/3e565505f2274f41aff395a267e0a7cb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:08.216703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] RBAC: Authorizing `identity:get_user(user_id=3e565505f2274f41aff395a267e0a7cb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:08.218390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:08.220188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 578/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:57:08 2022] GET /identity/v3/users/3e565505f2274f41aff395a267e0a7cb => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:08.226180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:08.242455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:08.324895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803e15d-37f1-4464-b021-07a0b489d1f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:08.357030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:08.357672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:08.357956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:08.358233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:08.422651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:08.424452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:08.438260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:08.520424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 566/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:57:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:57:08.526220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:08.621207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96ed76-d0e3-4607-86d4-db33587b184e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:08.653948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4be16a-56d1-4629-9bc4-99039eaa88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:08.654788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be16a-56d1-4629-9bc4-99039eaa88c5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:08.655069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be16a-56d1-4629-9bc4-99039eaa88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:08.655341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4be16a-56d1-4629-9bc4-99039eaa88c5 None admin] PATH_INFO: `/v3/projects/60a4aa726a6b4d60965783ea88187e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:08.656460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4be16a-56d1-4629-9bc4-99039eaa88c5 None admin] RBAC: Authorizing `identity:get_project(project_id=60a4aa726a6b4d60965783ea88187e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:08.657919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4be16a-56d1-4629-9bc4-99039eaa88c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:08.659561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 579/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:57:08 2022] GET /identity/v3/projects/60a4aa726a6b4d60965783ea88187e61 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:08.665579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:08.762374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5945d-bdaf-480f-92ce-7b15a8ba83c3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:08.776020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:08.800466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:08.801118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:08.801403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:08.801683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:08.802505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=60a4aa726a6b4d60965783ea88187e61, user.id=3e565505f2274f41aff395a267e0a7cb) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:08.802818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:08.804277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cf756-f7cf-48ac-b1ba-a4b7dc3c2125 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:08.809531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 567/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:57:08 2022] GET /identity/v3/role_assignments?user.id=3e565505f2274f41aff395a267e0a7cb&scope.project.id=60a4aa726a6b4d60965783ea88187e61&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:10.967882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73e8d-6f72-4259-b651-16400463cec8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:10.968407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73e8d-6f72-4259-b651-16400463cec8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:10.968407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73e8d-6f72-4259-b651-16400463cec8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:10.970296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 580/1147] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:10.975418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:10.975845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:10.976002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:10.993248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:10.994429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:11.059043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 568/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:11.082325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef73e8d-6f72-4259-b651-16400463cec8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:11.096787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:11.181221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef73e8d-6f72-4259-b651-16400463cec8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:11.214787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:11.215589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:11.216018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:11.216306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:11.226875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:57:11.234575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:11.235896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:11.237180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:57:11.239973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 581/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:57:11.242096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:11.336374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187376f-4fa3-4ab9-ba6a-862e3b844fc5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:11.346057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:11.369487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:11.370162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:11.370430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:11.370708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:11.371447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:11.371754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:11.373140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:11.381582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 569/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:11.387326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:11.456396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:11.484678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c50f2-b6fc-4f8f-acbb-beeda189dd0a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:11.518197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:11.519055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:11.519341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:11.519625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] PATH_INFO: `/v3/users/3e565505f2274f41aff395a267e0a7cb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:11.520827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] RBAC: Authorizing `identity:get_user(user_id=3e565505f2274f41aff395a267e0a7cb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:11.522263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:11.523886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 582/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:57:11 2022] GET /identity/v3/users/3e565505f2274f41aff395a267e0a7cb => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:11.529575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:11.624413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb441-dfc3-411a-a947-24e597699ebb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:11.656683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97234b-55a7-46bc-a372-33a16863a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:11.657545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97234b-55a7-46bc-a372-33a16863a34c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:11.657832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97234b-55a7-46bc-a372-33a16863a34c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:11.658107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97234b-55a7-46bc-a372-33a16863a34c None admin] PATH_INFO: `/v3/projects/60a4aa726a6b4d60965783ea88187e61` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:11.659261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97234b-55a7-46bc-a372-33a16863a34c None admin] RBAC: Authorizing `identity:get_project(project_id=60a4aa726a6b4d60965783ea88187e61)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:11.660703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97234b-55a7-46bc-a372-33a16863a34c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:11.662349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 570/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:57:11 2022] GET /identity/v3/projects/60a4aa726a6b4d60965783ea88187e61 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:11.668111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:11.764271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91573-48a4-4cab-a156-e7c1b972250b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:11.796533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed097d74-3dd2-45f0-a86e-2fd764254b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:11.797402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097d74-3dd2-45f0-a86e-2fd764254b14 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:11.798197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097d74-3dd2-45f0-a86e-2fd764254b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:11.798587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097d74-3dd2-45f0-a86e-2fd764254b14 None admin] PATH_INFO: `/v3/projects/60a4aa726a6b4d60965783ea88187e61/users/3e565505f2274f41aff395a267e0a7cb/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:11.800539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097d74-3dd2-45f0-a86e-2fd764254b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=60a4aa726a6b4d60965783ea88187e61, user_id=3e565505f2274f41aff395a267e0a7cb, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:11.801965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097d74-3dd2-45f0-a86e-2fd764254b14 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:11.905231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:11.909882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 583/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:57:11 2022] PUT /identity/v3/projects/60a4aa726a6b4d60965783ea88187e61/users/3e565505f2274f41aff395a267e0a7cb/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:57:14.082635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a49f-fee5-4673-bf11-8ff073cb12e4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:14.083194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a49f-fee5-4673-bf11-8ff073cb12e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:14.083194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a49f-fee5-4673-bf11-8ff073cb12e4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:14.084610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 571/1154] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:14.089831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:14.090222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:14.090389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:14.107158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:14.108360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:14.171891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 584/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:14.194933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a49f-fee5-4673-bf11-8ff073cb12e4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:14.236892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:14.296721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a49f-fee5-4673-bf11-8ff073cb12e4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:14.330158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:14.330944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:14.331243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:14.331519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:14.341544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:57:14.349839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:14.350757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:57:14.351658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 572/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:57:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:57:14.357123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:14.452984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a42c1-b755-4b75-a93f-de3bda179559 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:14.481196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:14.486753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:14.487434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:14.491921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:14.491921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:14.491921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:14.491921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:14.491921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:14.498148 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 585/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:14.504539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:14.602148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:14.605716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18688d-23dd-4630-8fb4-1a720d204204 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:14.638320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:14.639170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:14.639449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:14.639722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] PATH_INFO: `/v3/users/3e565505f2274f41aff395a267e0a7cb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:14.640910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] RBAC: Authorizing `identity:get_user(user_id=3e565505f2274f41aff395a267e0a7cb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:14.642377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:14.644011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 573/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:57:14 2022] GET /identity/v3/users/3e565505f2274f41aff395a267e0a7cb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:14.649763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:14.747136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93289b49-5018-4803-9cff-795ef9eaad18 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:14.778850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:14.779483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:14.779766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:14.780074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:14.836033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:14.844961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:14.846914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:14.940400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 586/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:57:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:57:14.946092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:15.042866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed17d8f-c15f-4d75-8549-c699b4a9695c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:15.077745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf0f89-0e40-4577-8b9a-765984967c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:15.078642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0f89-0e40-4577-8b9a-765984967c8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:15.079639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0f89-0e40-4577-8b9a-765984967c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:15.080033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0f89-0e40-4577-8b9a-765984967c8e None admin] PATH_INFO: `/v3/projects/60a4aa726a6b4d60965783ea88187e61` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:15.081892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf0f89-0e40-4577-8b9a-765984967c8e None admin] RBAC: Authorizing `identity:get_project(project_id=60a4aa726a6b4d60965783ea88187e61)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:15.082897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf0f89-0e40-4577-8b9a-765984967c8e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:15.084605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 574/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:57:14 2022] GET /identity/v3/projects/60a4aa726a6b4d60965783ea88187e61 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:15.090597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:15.177211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:15.185361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac11ef0-cdd2-42b3-97e3-892bd1ba8020 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:15.218900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:15.219519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:15.219815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:15.220138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:15.220968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=60a4aa726a6b4d60965783ea88187e61, user.id=3e565505f2274f41aff395a267e0a7cb) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:15.221280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:15.222720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598fa5-f1ad-4ca9-9431-6da9afb0d4cb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:15.228587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 587/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:57:15 2022] GET /identity/v3/role_assignments?user.id=3e565505f2274f41aff395a267e0a7cb&scope.project.id=60a4aa726a6b4d60965783ea88187e61&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:57:17.418712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48cf3-8b3d-4975-b301-d5b953561d48 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:17.419247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48cf3-8b3d-4975-b301-d5b953561d48 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:17.419247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada48cf3-8b3d-4975-b301-d5b953561d48 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:17.420667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 575/1162] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:17.425861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:17.426246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:17.426413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:17.443653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:17.444873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:17.509439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 588/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:17.532637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48cf3-8b3d-4975-b301-d5b953561d48 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:17.568410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:17.637688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada48cf3-8b3d-4975-b301-d5b953561d48 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:17.671853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:17.672484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:17.673578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:17.673969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:17.739902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:17.741342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:17.772662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:17.837772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 576/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:57:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:57:17.843750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:17.924942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:17.939310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7dc27a-379c-4fcd-9265-1277a8d5667f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:17.973363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:17.974140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:17.974419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:17.974691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:17.981136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:17.982689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-19976de6-69b6-41cc-acb4-3667fd9283f0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:17.996405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:18.002492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:57:18.003593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 589/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:57:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:57:18.004658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:18.100753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7e692-0974-4d9c-ba97-641cb9b305d1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:18.132960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:18.133604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:18.133886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:18.134159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:18.134866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:18.135169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:18.136543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f228a2-95d5-44f5-9daf-8d40118d8058 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:18.137935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:18.144545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 577/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Tue May 24 09:57:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:20.302121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017350-cfa6-4c95-9225-d2f2ceb6b77b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:20.302766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017350-cfa6-4c95-9225-d2f2ceb6b77b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:20.302766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017350-cfa6-4c95-9225-d2f2ceb6b77b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:20.304057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 590/1167] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:20.309331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cf11-b09a-477c-b127-f85ec9cd014b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:20.309783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cf11-b09a-477c-b127-f85ec9cd014b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:20.309887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627cf11-b09a-477c-b127-f85ec9cd014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:20.326622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6627cf11-b09a-477c-b127-f85ec9cd014b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:20.327787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6627cf11-b09a-477c-b127-f85ec9cd014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:20.392945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 578/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 24 09:57:20.415725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63017350-cfa6-4c95-9225-d2f2ceb6b77b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:20.514813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63017350-cfa6-4c95-9225-d2f2ceb6b77b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:20.546689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512d696-319d-48c9-8d62-6b1d649534f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:20.547375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d696-319d-48c9-8d62-6b1d649534f7 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:20.548191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d696-319d-48c9-8d62-6b1d649534f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:20.548541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512d696-319d-48c9-8d62-6b1d649534f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:20.549271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512d696-319d-48c9-8d62-6b1d649534f7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:20.550647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512d696-319d-48c9-8d62-6b1d649534f7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:20.618674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 591/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Tue May 24 09:57:20 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:57:22.803764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440669-cf2f-4b8e-aef5-ce30385ce441 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:22.804339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440669-cf2f-4b8e-aef5-ce30385ce441 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:22.804339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440669-cf2f-4b8e-aef5-ce30385ce441 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:22.805694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 579/1170] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:22.810988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:22.811408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:22.811523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:22.823920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:22.829603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:22.846163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:22.895056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 592/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:22.918669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440669-cf2f-4b8e-aef5-ce30385ce441 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:23.017975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440669-cf2f-4b8e-aef5-ce30385ce441 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:23.043290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:23.051312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6104f-605c-4df5-80dc-a86a4b0e922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:23.052714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6104f-605c-4df5-80dc-a86a4b0e922b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:23.052714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6104f-605c-4df5-80dc-a86a4b0e922b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:23.052714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6104f-605c-4df5-80dc-a86a4b0e922b None admin] PATH_INFO: `/v3/domains/02f475fda6ad4829945dc15e8c4e6ee7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:23.063708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6104f-605c-4df5-80dc-a86a4b0e922b None admin] RBAC: Authorizing `identity:get_domain(domain_id=02f475fda6ad4829945dc15e8c4e6ee7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:23.065319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6104f-605c-4df5-80dc-a86a4b0e922b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:23.067376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 580/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Tue May 24 09:57:22 2022] GET /identity/v3/domains/02f475fda6ad4829945dc15e8c4e6ee7 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:23.072930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:23.167637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99fecd-196f-4bfd-9eff-1940d8825529 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:23.201200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780b66-92b0-4ca7-8789-f79b4a1f5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:23.201849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780b66-92b0-4ca7-8789-f79b4a1f5a56 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:23.202136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780b66-92b0-4ca7-8789-f79b4a1f5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:23.202417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780b66-92b0-4ca7-8789-f79b4a1f5a56 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:23.203113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780b66-92b0-4ca7-8789-f79b4a1f5a56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:23.204694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780b66-92b0-4ca7-8789-f79b4a1f5a56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:23.208670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:23.269742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 593/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:57:23 2022] POST /identity/v3/projects => generated 361 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:57:25.485978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc72a-18e7-4326-8059-46adc8b5adb8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:25.486433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc72a-18e7-4326-8059-46adc8b5adb8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:25.486549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc72a-18e7-4326-8059-46adc8b5adb8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:25.487991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 581/1174] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:25.493644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d633-46b5-4660-9381-76a907515c02 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:25.494023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d633-46b5-4660-9381-76a907515c02 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:25.494205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d633-46b5-4660-9381-76a907515c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:25.510685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f476d633-46b5-4660-9381-76a907515c02 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:25.511900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f476d633-46b5-4660-9381-76a907515c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:25.582990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 594/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:25.607307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc72a-18e7-4326-8059-46adc8b5adb8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:25.704313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc72a-18e7-4326-8059-46adc8b5adb8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:25.737155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a62d-1eba-4084-84f9-bd7e0d349255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:25.737997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a62d-1eba-4084-84f9-bd7e0d349255 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:25.738275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a62d-1eba-4084-84f9-bd7e0d349255 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:25.738546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a62d-1eba-4084-84f9-bd7e0d349255 None admin] PATH_INFO: `/v3/domains/02f475fda6ad4829945dc15e8c4e6ee7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:25.739703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a62d-1eba-4084-84f9-bd7e0d349255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=02f475fda6ad4829945dc15e8c4e6ee7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:25.741150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a62d-1eba-4084-84f9-bd7e0d349255 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:25.742722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 582/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Tue May 24 09:57:25 2022] GET /identity/v3/domains/02f475fda6ad4829945dc15e8c4e6ee7 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:25.748302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d633-46b5-4660-9381-76a907515c02 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:25.843072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d633-46b5-4660-9381-76a907515c02 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:25.860730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:25.876731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be463f-5b57-413a-a79b-c857c95b4907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:25.877393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be463f-5b57-413a-a79b-c857c95b4907 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:25.877679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be463f-5b57-413a-a79b-c857c95b4907 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:25.877959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be463f-5b57-413a-a79b-c857c95b4907 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:25.878663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be463f-5b57-413a-a79b-c857c95b4907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:25.880136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be463f-5b57-413a-a79b-c857c95b4907 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:25.972430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 595/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:57:25 2022] POST /identity/v3/users => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:57:28.185997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e1004-719b-4a04-a3e3-8314b5228d45 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:28.186534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e1004-719b-4a04-a3e3-8314b5228d45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:28.186534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e1004-719b-4a04-a3e3-8314b5228d45 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:28.187920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 583/1178] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:28.193520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:28.193911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:28.194092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:28.211154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:28.212377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:28.277261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 596/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:28.301588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e1004-719b-4a04-a3e3-8314b5228d45 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:28.357115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:28.399688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e1004-719b-4a04-a3e3-8314b5228d45 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:28.433335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:28.434120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:28.434400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:28.434674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:28.445045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:57:28.452836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:28.454616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:57:28.455846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 584/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:57:28.460504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:28.554794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1f277-b8be-4b94-9a8b-50950d1689e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:28.557057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:28.587737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:28.588420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:28.588703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:28.588979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:28.589714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:28.590024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:28.591398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:28.604606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 597/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:28.610352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:28.706589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477ec05-a55c-403b-8e5e-279691bfd5ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:28.722370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:28.739876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:28.740734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:28.741016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:28.741290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] PATH_INFO: `/v3/users/19666f06f64945a3a39688863481361a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:28.754424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] RBAC: Authorizing `identity:get_user(user_id=19666f06f64945a3a39688863481361a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:28.755892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:28.757529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 585/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:57:28 2022] GET /identity/v3/users/19666f06f64945a3a39688863481361a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:28.763154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:28.861588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af39232-fd2d-4ddf-8d7a-dde7f95080d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:28.893095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:28.893725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:28.894010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:28.894286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:28.926651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:28.958948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:28.960414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:29.054197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 598/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:57:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:57:29.059978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:29.155522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c074f-1adf-4391-97ae-0de7bc0088d1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:29.188791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e8e74-09d9-403f-b48c-610c198fff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:29.189630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e8e74-09d9-403f-b48c-610c198fff57 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:29.189913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e8e74-09d9-403f-b48c-610c198fff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:29.190188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e8e74-09d9-403f-b48c-610c198fff57 None admin] PATH_INFO: `/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:29.191348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e8e74-09d9-403f-b48c-610c198fff57 None admin] RBAC: Authorizing `identity:get_project(project_id=1e3b908e11f34791bbb19daa4d28f3a2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:29.192792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e8e74-09d9-403f-b48c-610c198fff57 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:29.194458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 586/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:57:29 2022] GET /identity/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:29.200727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:29.262757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:29.296339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1127145-1a7d-47fe-9b4d-e521dab7ec72 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:29.329674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:29.330307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:29.330587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:29.330861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:29.331667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=1e3b908e11f34791bbb19daa4d28f3a2, user.id=19666f06f64945a3a39688863481361a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:29.332007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:29.333428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c94a81-2f86-4c22-b468-d69b4250eb8e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:29.338644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 599/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:57:29 2022] GET /identity/v3/role_assignments?user.id=19666f06f64945a3a39688863481361a&scope.project.id=1e3b908e11f34791bbb19daa4d28f3a2&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:57:31.471080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fd77-8c4b-4f18-9c59-cf0b67f760cd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:31.471590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fd77-8c4b-4f18-9c59-cf0b67f760cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:31.471695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fd77-8c4b-4f18-9c59-cf0b67f760cd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:31.473038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 587/1186] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:31.478486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803152-3ad9-44de-8775-40d4180980ec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:31.478898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803152-3ad9-44de-8775-40d4180980ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:31.479050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803152-3ad9-44de-8775-40d4180980ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:31.496314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55803152-3ad9-44de-8775-40d4180980ec None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:31.497491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55803152-3ad9-44de-8775-40d4180980ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:31.561797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 600/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:31.584889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fd77-8c4b-4f18-9c59-cf0b67f760cd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:31.628520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:31.683970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fd77-8c4b-4f18-9c59-cf0b67f760cd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:31.716995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:31.717722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:31.718064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:31.718284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:31.728872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:57:31.738110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:31.739286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:57:31.740502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 588/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:57:31.745259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55803152-3ad9-44de-8775-40d4180980ec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:31.801721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:31.840965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55803152-3ad9-44de-8775-40d4180980ec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:31.876933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:31.877582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:31.877863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:31.878132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:31.878858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:31.879157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:31.880569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:31.888361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 601/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:31.894366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:31.991780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277dd3e-70a7-483e-b1b4-6fabcfd79e6e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:31.993252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:32.023980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:32.024833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:32.025118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:32.025394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] PATH_INFO: `/v3/users/19666f06f64945a3a39688863481361a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:32.026555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=19666f06f64945a3a39688863481361a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:32.028005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:32.029606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 589/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:57:31 2022] GET /identity/v3/users/19666f06f64945a3a39688863481361a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:32.035851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:32.130373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0c1a-569f-4042-832b-643216f22391 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:32.151548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:32.162431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970e34-9f98-4469-a290-1144fad5cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:32.163274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970e34-9f98-4469-a290-1144fad5cfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:32.163556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970e34-9f98-4469-a290-1144fad5cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:32.163850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970e34-9f98-4469-a290-1144fad5cfe8 None admin] PATH_INFO: `/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:32.164993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970e34-9f98-4469-a290-1144fad5cfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=1e3b908e11f34791bbb19daa4d28f3a2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:32.166412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970e34-9f98-4469-a290-1144fad5cfe8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:32.168082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 602/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:57:32 2022] GET /identity/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:32.174546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:32.271832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b161dc7-5031-4ae5-9656-ab911ef9d7d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:32.304323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3030d-ae91-4040-baa6-3c2ad7835d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:32.305627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3030d-ae91-4040-baa6-3c2ad7835d94 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:32.305627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3030d-ae91-4040-baa6-3c2ad7835d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:32.305815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3030d-ae91-4040-baa6-3c2ad7835d94 None admin] PATH_INFO: `/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2/users/19666f06f64945a3a39688863481361a/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:32.307743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3030d-ae91-4040-baa6-3c2ad7835d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b908e11f34791bbb19daa4d28f3a2, user_id=19666f06f64945a3a39688863481361a, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:32.309177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3030d-ae91-4040-baa6-3c2ad7835d94 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:32.415924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 590/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:57:32 2022] PUT /identity/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2/users/19666f06f64945a3a39688863481361a/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:57:34.569986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f74b-f16f-46c7-96fb-e2cda0fb0815 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:34.570554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f74b-f16f-46c7-96fb-e2cda0fb0815 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:34.570554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f74b-f16f-46c7-96fb-e2cda0fb0815 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:34.571905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 603/1193] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:57:34.577312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:34.577682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:34.577882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:34.594826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:57:34.596063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:57:34.619488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:34.661593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 591/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:57:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:57:34.685192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f74b-f16f-46c7-96fb-e2cda0fb0815 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:34.784718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f74b-f16f-46c7-96fb-e2cda0fb0815 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:34.817455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:34.818233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:34.818519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:34.818797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:34.829469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:57:34.837153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:57:34.838255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:57:34.839301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 604/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:57:34.844544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:34.940870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea63e6e-a456-4c25-89a7-7051bd62a7fc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:34.973891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:34.974548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:34.974832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:34.975152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:34.975902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:34.976212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:34.977573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:34.985520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 592/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:34.991250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:35.040509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:35.088939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f4ce2-bccb-48f7-bb51-66ab0cbc99a2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:35.120935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:35.121792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:35.122075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:35.122349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] PATH_INFO: `/v3/users/19666f06f64945a3a39688863481361a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:35.123509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] RBAC: Authorizing `identity:get_user(user_id=19666f06f64945a3a39688863481361a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:35.125119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:35.126840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 605/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Tue May 24 09:57:34 2022] GET /identity/v3/users/19666f06f64945a3a39688863481361a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:35.132636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:35.158709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:35.232160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3ec8b-063c-41aa-ab57-468d0ebf84ce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:35.264179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:35.264810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:35.265091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:35.265366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:35.331377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:35.332836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:35.354985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:35.426539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 593/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:57:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:57:35.432540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:35.529648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32857c-c754-4df8-b0de-1c0f8d918169 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:35.546216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:35.562149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772570b3-fe43-4f53-b2c0-c97e33e19d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:35.563544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772570b3-fe43-4f53-b2c0-c97e33e19d1a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:35.563849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772570b3-fe43-4f53-b2c0-c97e33e19d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:35.564127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772570b3-fe43-4f53-b2c0-c97e33e19d1a None admin] PATH_INFO: `/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:35.565289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772570b3-fe43-4f53-b2c0-c97e33e19d1a None admin] RBAC: Authorizing `identity:get_project(project_id=1e3b908e11f34791bbb19daa4d28f3a2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:35.566746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772570b3-fe43-4f53-b2c0-c97e33e19d1a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:35.568446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 606/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Tue May 24 09:57:35 2022] GET /identity/v3/projects/1e3b908e11f34791bbb19daa4d28f3a2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:35.575062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:57:35.671474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23b50b-f614-491c-b963-3a971927dd42 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:57:35.693136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:35.705092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:57:35.707690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:57:35.707690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:57:35.707690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:57:35.707690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=1e3b908e11f34791bbb19daa4d28f3a2, user.id=19666f06f64945a3a39688863481361a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:57:35.707690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:57:35.708817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca0484-9ff7-429b-b2b1-dfe7a0b22fd7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:57:35.714495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 594/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:57:35 2022] GET /identity/v3/role_assignments?user.id=19666f06f64945a3a39688863481361a&scope.project.id=1e3b908e11f34791bbb19daa4d28f3a2&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:57:45.583494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:57:45.726980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:51.612085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f4f2-27f1-4c46-a30d-327d7cd36e6e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:51.613193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f4f2-27f1-4c46-a30d-327d7cd36e6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:51.613193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9f4f2-27f1-4c46-a30d-327d7cd36e6e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:51.614515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 607/1201] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:58:51.619702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:51.620124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:51.620298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:51.638024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:58:51.639262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:58:51.706166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 595/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:58:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:58:51.730537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9f4f2-27f1-4c46-a30d-327d7cd36e6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:51.835869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9f4f2-27f1-4c46-a30d-327d7cd36e6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:51.870222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:51.871019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:51.871307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:51.871586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:51.882097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:51.883565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:58:51.901726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:51.903038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:51.904382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:58:51.904382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:58:51.904382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:51.904382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:58:51.904382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 608/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:51.910123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:52.008235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ea25b-1b2e-405f-9185-c34dd1716fb4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:52.038111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:52.044072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:52.044815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:52.045123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:52.045457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:52.046184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:52.046497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:52.047930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27379be-7c4f-4a66-9b40-c4d2ef75a00c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:52.059699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 596/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:52.065422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:52.118452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:52.165171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d99f1-59ac-4ec9-9770-1fb14589d7cb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:52.197722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb4e9-e9e5-49b2-b09c-5340991c5505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:52.198407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb4e9-e9e5-49b2-b09c-5340991c5505 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:52.198946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb4e9-e9e5-49b2-b09c-5340991c5505 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:52.199224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb4e9-e9e5-49b2-b09c-5340991c5505 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:52.199935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb4e9-e9e5-49b2-b09c-5340991c5505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:52.201374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb4e9-e9e5-49b2-b09c-5340991c5505 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:52.289625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 609/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Tue May 24 09:58:52 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:58:54.497319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b9ee2-98e7-4f56-983f-26f6fabebf92 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:54.497814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b9ee2-98e7-4f56-983f-26f6fabebf92 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:54.497958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b9ee2-98e7-4f56-983f-26f6fabebf92 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:54.499322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 597/1206] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:58:54.505169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:54.507551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:54.507551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:54.522396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:58:54.523655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:58:54.588766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 610/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:58:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:58:54.613028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b9ee2-98e7-4f56-983f-26f6fabebf92 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:54.716433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b9ee2-98e7-4f56-983f-26f6fabebf92 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:54.750363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:54.751157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:54.751444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:54.751723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:54.763193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:58:54.771405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:54.772589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:58:54.773537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 598/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:58:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:54.778829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:54.818253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:54.876194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a771656-2924-45f2-b137-6f48dbb02edc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:54.909018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:54.910192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:54.910625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:54.910916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:54.911735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:54.912074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:54.913443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:54.921193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 611/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:54.927583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:54.978802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:55.027003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94200568-dd62-4359-8bcb-8e80dd5daacd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:55.060443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:55.061223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:55.061511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:55.061792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:55.071599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:55.073107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:58:55.090579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:55.091536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:55.092947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:58:55.092947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:58:55.092947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:55.092947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:58:55.092947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 599/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:55.098071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:55.193336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:55.196233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db5a7-f5d1-4ef4-8706-629067761188 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:55.230640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:55.231240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:55.231519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:55.231792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:55.232536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:55.232862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:55.234243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:55.245118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 612/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:55.251019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:55.351687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ad51-0b65-414b-9c6f-fba6cd1e9e5d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:55.353330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:55.385147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:55.385994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:55.386276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:55.386549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:55.393409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:55.395392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:58:55.410385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:55.411579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:58:55.412781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 600/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:55.417547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:55.518219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9781d-312c-4d0d-b706-77a79058ee30 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:55.552759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:55.553427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:55.553713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:55.554013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:55.554843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:55.555153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:55.556614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:55.573836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 613/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Tue May 24 09:58:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:55.579638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:55.678839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eec2b-f16a-4ed3-87dd-0439d211cd9e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:55.712417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:55.713065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:55.713351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:55.713631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:55.743584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:55.781524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:55.782913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:55.881302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 601/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:58:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:58:55.887309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:55.906303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:55.985354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ddf1f-da79-41dd-b40c-683c9a222d30 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:56.019485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:56.020331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:56.020619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:56.020899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:56.030794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:56.032333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:58:56.049540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:56.051044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:56.052053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:58:56.052053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:58:56.052053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:56.052053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:58:56.052053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 614/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:56.057068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:56.117532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:56.154597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a628a86-e9b8-40ae-941a-8d941cf62810 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:56.186965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:56.187614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:56.187921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:56.188193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:56.188898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:56.189198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:56.190550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:56.203622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 602/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:56.209307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:56.275619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:56.306251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d13964-8786-4fac-a8e5-700bd3b25719 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:56.338909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:56.339690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:56.340005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:56.340278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:56.347331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:56.348845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:58:56.363638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:56.364665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:58:56.365694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 615/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:56.370666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:56.470591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376789-c96d-44f5-8e7f-d5ea25749736 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:56.493435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:56.504581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:56.505236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:56.505516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:56.505786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:56.506562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:56.506869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:56.508333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18d2c3-a359-4644-ad2c-1cae62a618a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:56.520195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 603/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:56.526284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:56.622829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7a03-c273-4661-9c75-f7e8f10ad5e7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:56.650513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:56.656186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:56.656828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:56.657106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:56.657378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:56.658192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6db55e0a3baa4da1b2e1eba24a6a7e12) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:56.658498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:56.660765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060e670-c36b-4860-be9e-b86ef740be02 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:56.666004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 616/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:58:56 2022] GET /identity/v3/role_assignments?user.id=6db55e0a3baa4da1b2e1eba24a6a7e12&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:58.844805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e85c-76de-4659-8971-1a122f6bcb5e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:58.845345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e85c-76de-4659-8971-1a122f6bcb5e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:58.845345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49e85c-76de-4659-8971-1a122f6bcb5e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:58.847227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 604/1220] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:58:58.852529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:58.856577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:58.856577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:58.871697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:58:58.875462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:58:58.939040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 617/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:58:58.962444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e85c-76de-4659-8971-1a122f6bcb5e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:59.073539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49e85c-76de-4659-8971-1a122f6bcb5e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:59.108047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:59.108780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:59.109070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:59.109348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:59.119330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:58:59.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:59.128257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:58:59.129229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 605/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:59.134677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:59.231054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4c2c6-9f44-4591-9b3c-49a2d2c6e1ff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:59.253909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:59.263916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:59.264575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:59.264854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:59.265123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:59.265855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:59.266157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:59.267526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:59.275786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 618/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:58:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:58:59.281522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:59.323034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:59.377490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ad7a-7d7c-4af5-b6ab-b0096f52ff7d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:59.410946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:59.411726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:59.412034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:59.412306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:59.422605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:59.424065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:58:59.441655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:59.442945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:59.444128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:58:59.444128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:58:59.444128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:58:59.444128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:58:59.447348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 606/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:59.448890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:59.545077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b64000-2c24-478b-a8aa-7b5eeacc4d27 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:59.578144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:59.578793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:59.579075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:59.579346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:59.580081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:59.580382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:59.582499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:59.593822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 619/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:59.599657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:59.692941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:59.700577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8ffa-72f6-45cf-9453-217135a81db7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:59.734431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:59.735289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:59.735572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:59.735879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:59.742956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:59.744433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:58:59.759327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:58:59.760473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:58:59.761839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 607/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:58:59.766477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:58:59.813031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:58:59.865987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786e492-9992-4151-9ccc-194080c98352 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:58:59.899213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:58:59.899907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:58:59.900197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:58:59.900477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:58:59.901305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:58:59.901619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:58:59.903055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:58:59.919767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 620/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Tue May 24 09:58:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:58:59.926275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:00.023007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57acac0-8d20-467d-aa0a-fc1a65843611 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:00.057080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:00.057870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:00.058154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:00.058440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:00.068616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:00.070054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:00.087555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:00.088635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:00.089927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:00.089927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:00.089927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:00.089927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:00.089927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 608/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:00.094589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:00.192528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fe312-57f4-4642-8787-f7a1a9137b5e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:00.194791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:00.226684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:00.227376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:00.227692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:00.227995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:00.228709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:00.229014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:00.230437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:00.242461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 621/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:59:00.248229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:00.257258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:00.345764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4185c84-ccf4-44b2-89c2-44b5b9addb1c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:00.380188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:00.380971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:00.381252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:00.381528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:00.387987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:00.389411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:59:00.403292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:00.404383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:00.405501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 609/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:00.410920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:00.509178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c1064-fb18-46db-a960-c0e51bec48f2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:00.542255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:00.542906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:00.543189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:00.543464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:00.544267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:00.544577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:00.546009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91213422-f278-4ca8-8186-b509e82c50b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:00.557883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 622/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:00.563941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:00.628445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:00.662141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104b827-95fd-49d0-80f1-d8faec082e1f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:00.693667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9e3f6-98ac-4a76-9b28-fbe6c9f06a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:00.694543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9e3f6-98ac-4a76-9b28-fbe6c9f06a76 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:00.694824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9e3f6-98ac-4a76-9b28-fbe6c9f06a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:00.695100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9e3f6-98ac-4a76-9b28-fbe6c9f06a76 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6db55e0a3baa4da1b2e1eba24a6a7e12/roles/f4b94c55a8214a739b20aea281d7b9ca` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:00.709743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9e3f6-98ac-4a76-9b28-fbe6c9f06a76 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=6db55e0a3baa4da1b2e1eba24a6a7e12, role_id=f4b94c55a8214a739b20aea281d7b9ca)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:00.711171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9e3f6-98ac-4a76-9b28-fbe6c9f06a76 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:00.802995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 610/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:59:00 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6db55e0a3baa4da1b2e1eba24a6a7e12/roles/f4b94c55a8214a739b20aea281d7b9ca => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:59:02.977593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4b7c-16ca-4b2e-a075-c16fc3495277 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:02.978194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4b7c-16ca-4b2e-a075-c16fc3495277 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:02.978194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f4b7c-16ca-4b2e-a075-c16fc3495277 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:02.979488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 623/1233] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:02.984584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:02.984971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:02.985141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:03.002711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:03.004623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:03.070109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 611/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:03.093127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4b7c-16ca-4b2e-a075-c16fc3495277 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:03.118936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:03.191228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f4b7c-16ca-4b2e-a075-c16fc3495277 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:03.225338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:03.226132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:03.226421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:03.226703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:03.236939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:59:03.245519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:03.246754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:03.253107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 624/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Tue May 24 09:59:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:03.254443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:03.299185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:03.349815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23900d8b-1895-421c-bd76-532f53d95f0e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:03.382307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:03.382966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:03.383248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:03.383520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:03.384292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:03.384594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:03.385949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:03.394284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 612/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Tue May 24 09:59:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:03.400102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:03.485015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:03.500125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd504a-92c3-4472-bd8b-9eab814924f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:03.532518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:03.533306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:03.533585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:03.533858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:03.544256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:03.545688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:03.562895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:03.564088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:03.569732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:03.569732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:03.569732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:03.569732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:03.569732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 625/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:03.570056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:03.667852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25299cc-1ec7-4600-a570-4ba700b0855f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:03.676535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:03.700575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:03.701229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:03.701512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:03.701787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:03.702496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:03.702800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:03.704200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:03.716296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 613/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:03.722465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:03.818504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18defcf-e30b-4252-a71f-8b0259d13d34 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:03.851700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:03.852516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:03.852796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:03.853068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:03.855761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:03.860394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:03.861842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:59:03.876790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:03.878543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:03.879724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 626/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:03.884292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:03.982766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131012e-7376-40df-b536-aa47fcbd66ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:04.016871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:04.017521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:04.017803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:04.018104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:04.019516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:04.019846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:04.021280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:04.038248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 614/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Tue May 24 09:59:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:04.044250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:04.146150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bec80-195c-484b-95c7-3bbe2ff9586e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:04.179958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:04.180611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:04.181087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:04.181367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:04.242317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:04.248874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:04.250342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:04.346861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 627/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:59:04.352866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:04.381134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:04.455940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df2a8-48d6-4f2d-b119-350c26125b32 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:04.489332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:04.490117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:04.490399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:04.490674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:04.500652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:04.502064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:04.520604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:04.521686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:04.522674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:04.522674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:04.522674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:04.522674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:04.522674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 615/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:04.527665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:04.620191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:04.625708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e04f6-232e-41ea-9b13-7392b5c51781 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:04.658894 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:04.660111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:04.660477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:04.660758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:04.661479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:04.661784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:04.663157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:04.674481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 628/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:04.680674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:04.756118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:04.776076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c6c0e-b368-4ca8-9d1d-5666e9d37de8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:04.808940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:04.809718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:04.809998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:04.810272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:04.816797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:04.818216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:59:04.831775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:04.835704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:04.836712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 616/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:59:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:04.838648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:04.938009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37ef12-bc5d-4905-a261-229cb8d5ec2f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:04.970797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:04.971476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:04.971844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:04.972211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:04.972993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:04.973304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:04.974738 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728296d3-a807-44d2-ad54-38e5bb494b4e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:04.986307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 629/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:59:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:04.993131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:05.090285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cfdf-8ccf-4a50-a38b-cfa4c89f2c95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:05.122503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:05.123149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:05.123493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:05.123703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:05.124556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] RBAC: Adding query filter params (role.id=f4b94c55a8214a739b20aea281d7b9ca, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6db55e0a3baa4da1b2e1eba24a6a7e12) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:05.124866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:05.126281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a636c-25d7-4b2d-a22a-5589204be4f0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:05.132542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 617/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:59:04 2022] GET /identity/v3/role_assignments?user.id=6db55e0a3baa4da1b2e1eba24a6a7e12&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=f4b94c55a8214a739b20aea281d7b9ca => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:07.391349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663aa59-fdff-4598-89b1-8cf6daebc511 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:07.391903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663aa59-fdff-4598-89b1-8cf6daebc511 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:07.392019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663aa59-fdff-4598-89b1-8cf6daebc511 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:07.393782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 630/1247] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:07.399189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:07.399698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:07.399867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:07.405112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:07.417738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:07.418923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:07.483314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 618/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:07.507648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663aa59-fdff-4598-89b1-8cf6daebc511 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:07.526139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:07.607992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663aa59-fdff-4598-89b1-8cf6daebc511 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:07.641447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:07.642171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:07.642450 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:07.642719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:07.653620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:59:07.661464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:07.662646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:07.663888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 631/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:07.668755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:07.765310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43a42-5074-4d37-9812-795827e679ea None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:07.794106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:07.798870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:07.799553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:07.799870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:07.800149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:07.800888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:07.801193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:07.802552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:07.810324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 619/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:07.816926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:07.896296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:07.917539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b15b8-5ee6-49a3-a1d6-6a81167499a7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:07.951562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:07.952373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:07.952652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:07.952921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:07.962959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:07.964461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:07.982114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:07.990378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:07.991414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:07.991414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:07.991414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:07.991414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:07.991414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 632/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:07.991710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:08.089138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ddab8-2af1-44b7-b367-403641de6603 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:08.122686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:08.123339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:08.123624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:08.123926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:08.124639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:08.124945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:08.126298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:08.137734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 620/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:08.144376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:08.241871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f3c6c-6cc3-461b-af82-74e7ae4365ab None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:08.268096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:08.276123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:08.276918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:08.277210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:08.277489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:08.285509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:08.286949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:59:08.301589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:08.302814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:08.303974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 633/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:08.308680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:08.364845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:08.408561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dd776-43df-4eb4-b02c-213428b90127 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:08.443725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:08.444424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:08.444708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:08.444982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:08.445888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:08.446111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:08.447543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:08.465072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 621/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Tue May 24 09:59:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:08.470931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:08.570609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db450361-8bfc-403c-8a9b-9cb51d37897b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:08.603521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:08.604182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:08.604468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:08.604747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:08.660248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:08.672412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:08.673866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:08.767673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 634/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:59:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:59:08.774282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:08.869884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77e843-2f17-42de-80d4-fd4ebcffd602 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:08.882365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:08.902669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:08.903455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:08.903735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:08.904035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:08.914354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:08.915772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:08.932718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:08.934155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:08.935135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:08.935135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:08.935135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:08.935135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:08.935135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 622/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:08.939513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:09.029674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:09.041032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c743-44ef-4ecf-8d27-5c5940923090 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:09.074146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:09.074777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:09.075056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:09.075326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:09.076059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:09.076360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:09.077747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:09.089103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 635/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:09.094817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:09.193544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d93f77-a742-43e3-8f2f-4603effbc7a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:09.227467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:09.228273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:09.228552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:09.228819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:09.235313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:09.236772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:59:09.251565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:09.252671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:09.253646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 623/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:59:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:09.258810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:09.359780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3625b2-1b0f-4f19-98ec-7048ad74d12f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:09.392460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:09.393126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:09.393890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:09.394308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:09.395101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:09.395410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:09.396940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f40a1-acdd-41fe-a784-b01ea12502f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:09.408533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 636/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:59:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:09.415414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:09.442086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:09.515173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2392f1e-e41b-4419-ae74-8c963b12d5aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:09.548660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:09.549313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:09.549602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:09.549883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:09.550706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6db55e0a3baa4da1b2e1eba24a6a7e12) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:09.551019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:09.552489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb8da-5713-488a-93f8-f64716c6c3f2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:09.557989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 624/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:59:09 2022] GET /identity/v3/role_assignments?user.id=6db55e0a3baa4da1b2e1eba24a6a7e12&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:11.710540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68602b-15b2-48ec-8ce3-9fb0395c157b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:11.711084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68602b-15b2-48ec-8ce3-9fb0395c157b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:11.711084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68602b-15b2-48ec-8ce3-9fb0395c157b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:11.712487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 637/1261] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:11.717758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:11.718175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:11.718314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:11.735646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:11.736842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:11.803261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 625/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:11.826607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68602b-15b2-48ec-8ce3-9fb0395c157b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:11.838013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:11.927451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68602b-15b2-48ec-8ce3-9fb0395c157b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:11.960196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:11.961017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:11.961253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:11.961523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:11.971207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:59:11.979412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:11.980578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:11.981652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 638/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:11.986585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:12.005896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:12.085616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c27f1-492c-4490-9a80-4a29a059f4f7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:12.118294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:12.118950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:12.119235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:12.119513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:12.120283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:12.120590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:12.121956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:12.135910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 626/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:12.141768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:12.207873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:12.239732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68c43-2af8-4860-804d-aea7b161e861 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:12.272752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:12.273526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:12.273809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:12.274083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:12.284659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:12.286128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:12.302963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:12.304125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:12.305240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:12.305240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:12.305240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:12.305240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:12.307949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 639/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:12.310610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:12.390695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:12.409445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36d58-45ad-43e4-a321-23e14f62af41 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:12.444909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:12.445571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:12.445852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:12.446114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:12.446828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:12.447130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:12.448551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:12.460311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 627/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:59:12.465936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:12.564095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44449e2-1fd0-416b-9787-dcdef3d18dee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:12.584300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:12.597701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:12.598497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:12.598778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:12.599089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:12.606470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:12.607959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:59:12.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:12.623556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:12.624963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 640/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:12.629979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:12.728210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ddf0-c07a-4032-958a-4d66efef44e1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:12.766722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:12.767392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:12.767675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:12.768037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:12.769068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:12.769388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:12.770854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:12.781623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:12.791833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 628/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Tue May 24 09:59:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:12.796284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:12.904230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf7f0-8743-4891-8159-17afa72b243d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:12.938107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:12.938998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:12.939358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:12.939706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:12.951758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:12.953309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:12.971129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:12.972432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:12.973680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:12.973680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:12.973680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:12.973680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:12.973680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 641/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:12.978710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:13.077497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80c0fe-7bfc-4d74-ba97-1f06727fba3a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:13.112290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:13.113048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:13.113326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:13.113596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:13.114306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:13.114609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:13.115991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:13.126845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 629/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:59:13.132694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:13.164999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:13.233133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0ca5-6763-4c69-adc3-943edd171d59 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:13.266317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:13.267102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:13.267381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:13.267648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:13.275121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:13.280157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:59:13.292484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:13.293497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:13.294579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 642/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:13.299825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:13.358353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:13.399305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8c1e3-5983-41b2-9d12-4570caf86a5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:13.433754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:13.434397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:13.434745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:13.435025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:13.435830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:13.436147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:13.437567 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84cfad-1f74-4d66-bb6b-4543eddf3c46 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:13.450693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 630/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:59:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 09:59:13.456916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:13.548114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:13.556468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b527b-0491-485e-8bb1-96dc77f9b632 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:13.589349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a7ff2-ee55-4238-9175-79480a436960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:13.590406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a7ff2-ee55-4238-9175-79480a436960 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:13.590760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a7ff2-ee55-4238-9175-79480a436960 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:13.591106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a7ff2-ee55-4238-9175-79480a436960 None admin] PATH_INFO: `/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6db55e0a3baa4da1b2e1eba24a6a7e12/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:13.593180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a7ff2-ee55-4238-9175-79480a436960 None admin] RBAC: Authorizing `identity:create_grant(project_id=43fef3448c934a39802eb1a5c645c18c, user_id=6db55e0a3baa4da1b2e1eba24a6a7e12, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:13.594626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a7ff2-ee55-4238-9175-79480a436960 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:13.671358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 643/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Tue May 24 09:59:13 2022] PUT /identity/v3/projects/43fef3448c934a39802eb1a5c645c18c/users/6db55e0a3baa4da1b2e1eba24a6a7e12/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 09:59:15.816789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cc1e3-fd59-48a6-89ff-5b0fa328dafd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:15.817327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cc1e3-fd59-48a6-89ff-5b0fa328dafd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:15.817327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cc1e3-fd59-48a6-89ff-5b0fa328dafd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:15.819906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 631/1274] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:15.824074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:15.824452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:15.824645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:15.841803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:15.842998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:15.906735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 644/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:15.930061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cc1e3-fd59-48a6-89ff-5b0fa328dafd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.029582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cc1e3-fd59-48a6-89ff-5b0fa328dafd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:16.046161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:16.062748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:16.063527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:16.063833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:16.064114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:16.074592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 24 09:59:16.082740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:16.083905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:16.084965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 632/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Tue May 24 09:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:16.089952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.168863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:16.186222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bdde3-45db-45ca-aa1f-0f64b8eb21cb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:16.219954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:16.220609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:16.220892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:16.221255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:16.222066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:16.222379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:16.223758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:16.231455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 645/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Tue May 24 09:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:16.237664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.335712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7287d-72eb-4706-a191-1bf39f2e8da2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:16.368657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:16.369437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:16.369722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:16.369998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:16.380481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:16.381923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:16.399391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:16.400476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:16.401634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:16.401634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:16.401634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:16.401634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:16.401634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 633/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:16.406291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.505887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6ff0-5288-4f98-a672-d73311c0867e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:16.538878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:16.539533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:16.539834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:16.540120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:16.540838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:16.541146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:16.542519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:16.554131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 646/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:16.559765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.591405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:16.658376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5f95a-d3c2-49da-a039-0443d26b5534 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:16.692237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:16.693032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:16.693318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:16.693595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:16.700922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:16.702368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 24 09:59:16.717394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:16.722013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:16.722996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 634/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:16.728822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.732600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:16.826257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99766cbe-92b0-4ea4-99dc-4e84a9c02d09 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:16.859093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:16.859702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:16.860013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:16.860297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:16.861122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:16.861432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:16.863760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:16.881295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 647/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Tue May 24 09:59:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:16.887138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:16.976749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:16.986233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0826e3-f1dd-4673-bb08-e04250c99097 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:17.021837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:17.022483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:17.022769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:17.023049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:17.089074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:17.090516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:17.175390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:17.185190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 635/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Tue May 24 09:59:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 24 09:59:17.191861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:17.253129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:17.290402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d07c6-db0b-411d-80f7-531727f263b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:17.322222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:17.323009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:17.323291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:17.323564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:17.333965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:17.335406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 24 09:59:17.352482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:17.353577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:17.354921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 24 09:59:17.354921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 24 09:59:17.354921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 24 09:59:17.354921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:17.354921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 648/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 09:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:17.359375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:17.462319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748e9b1-5769-46bc-8fcb-dce8583d06ee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:17.496205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:17.496868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:17.497151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:17.497428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:17.498146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:17.498451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:17.499826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:17.510862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 636/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Tue May 24 09:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:17.516587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:17.616388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639099b-5bcb-4295-b666-f3117c0a6cdc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:17.630179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:17.649971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:17.650775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:17.651057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:17.651413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:17.658045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:17.660229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) May 24 09:59:17.675204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:17.679066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: ERROR keystone.server.flask.application May 24 09:59:17.680271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 649/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Tue May 24 09:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:17.682479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:17.732677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:17.780679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845babcc-e641-4539-85eb-442dcb36f3b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:17.814256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:17.815014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:17.815578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:17.815953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:17.816755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:17.817073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:17.818524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d77621-93a9-4bf5-b65c-1c93c78d2d7a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:17.833457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 637/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Tue May 24 09:59:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:17.840073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:17.950755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d8b25-fb2b-4062-a7d1-da7aac3b67e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:17.989600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:17.990189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:17.990469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:17.990742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:17.991620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] RBAC: Adding query filter params (role.id=97df1e81848642bb9115cb9c5b5789ad, scope.project.id=43fef3448c934a39802eb1a5c645c18c, user.id=6db55e0a3baa4da1b2e1eba24a6a7e12) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:17.991963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:17.993472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631078b-096a-4b9e-8e4b-15ac37c88974 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:18.000045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 650/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Tue May 24 09:59:17 2022] GET /identity/v3/role_assignments?user.id=6db55e0a3baa4da1b2e1eba24a6a7e12&scope.project.id=43fef3448c934a39802eb1a5c645c18c&role.id=97df1e81848642bb9115cb9c5b5789ad => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:20.255197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982bfe-db7c-4012-83de-4484b1b298d4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:20.255757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982bfe-db7c-4012-83de-4484b1b298d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:20.255757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03982bfe-db7c-4012-83de-4484b1b298d4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:20.257479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 638/1288] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:20.262786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:20.263203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:20.263344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:20.280315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:20.281491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:20.310179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:20.347089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 651/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:20.369225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982bfe-db7c-4012-83de-4484b1b298d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:20.469604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03982bfe-db7c-4012-83de-4484b1b298d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:20.480653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:20.503684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:20.504509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:20.504794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:20.505071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:20.505791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:20.507110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:20.519342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:20.520594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:20.521529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 639/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:59:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:20.526676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:20.624023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c611e8-725e-4d33-8915-f78348590a9d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:20.656886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:20.657540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:20.657826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:20.658103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:20.659362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:20.659664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:20.661144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b7922-fa65-4141-8426-bcd7c2ef8ece None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:20.665847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 652/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Tue May 24 09:59:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:20.671503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:20.771076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28754244-ec34-4bb3-9a39-f79e174cc0e7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:20.803943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:20.804597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:20.804948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:20.805143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:20.805843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:20.806150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:20.807507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4974df-677b-4dae-aa4d-06bce3f3d062 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:20.811853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 640/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Tue May 24 09:59:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:23.041658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5026b-4769-4808-b983-f813aa1af620 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:23.042326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5026b-4769-4808-b983-f813aa1af620 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:23.042326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5026b-4769-4808-b983-f813aa1af620 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:23.043592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 653/1293] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:23.049008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57149a6b-0451-4259-b4c5-e80a7f89d22f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:23.052218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57149a6b-0451-4259-b4c5-e80a7f89d22f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:23.052218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57149a6b-0451-4259-b4c5-e80a7f89d22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:23.066396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-57149a6b-0451-4259-b4c5-e80a7f89d22f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:23.067572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57149a6b-0451-4259-b4c5-e80a7f89d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:23.097882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:23.133757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 641/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:23.156925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5026b-4769-4808-b983-f813aa1af620 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:23.188122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:23.260383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5026b-4769-4808-b983-f813aa1af620 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:23.293406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb99fb-2b89-4035-9541-c8f1139fb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:23.294086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb99fb-2b89-4035-9541-c8f1139fb82f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:23.294415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb99fb-2b89-4035-9541-c8f1139fb82f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:23.294685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb99fb-2b89-4035-9541-c8f1139fb82f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:23.295403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb99fb-2b89-4035-9541-c8f1139fb82f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:23.296832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb99fb-2b89-4035-9541-c8f1139fb82f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:23.387174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 654/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Tue May 24 09:59:23 2022] POST /identity/v3/services => generated 246 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:59:25.600889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f6cfc-879b-4e8c-bd4b-4273e3ab9ac8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:25.601446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f6cfc-879b-4e8c-bd4b-4273e3ab9ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:25.601446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f6cfc-879b-4e8c-bd4b-4273e3ab9ac8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:25.602804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 642/1296] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:25.608203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:25.608608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:25.608826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:25.625589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:25.626808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:25.697823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 655/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:25.720559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f6cfc-879b-4e8c-bd4b-4273e3ab9ac8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:25.822565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f6cfc-879b-4e8c-bd4b-4273e3ab9ac8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:25.855763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:25.856570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:25.856852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:25.857124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:25.857800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:25.859122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:25.871853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:25.873167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:25.874100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 643/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:59:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:25.879416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:25.897938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:25.975906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80dbd-f562-40c6-acd3-4d49735d494a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:26.011754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:26.012514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:26.012802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:26.013075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:26.013772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:26.014079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:26.015454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:26.020696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 656/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Tue May 24 09:59:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:26.026594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:26.057466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:26.124172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0157f-5afb-4ad6-9429-63a5bb295fd5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:26.160254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:26.160900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:26.161187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:26.161470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:26.162260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] RBAC: Adding query filter params (interface=public, service_id=9b8d9e2106544857a822e187c6826f05, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:26.162647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:26.164036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a24de-e4d0-4da0-a921-2c1ec242af11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:26.169078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 644/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Tue May 24 09:59:26 2022] GET /identity/v3/endpoints?service_id=9b8d9e2106544857a822e187c6826f05&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:26.174697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:26.256712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:26.274627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f1db5-6e6b-48aa-8fcf-705cdbe85f32 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:26.306795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bfaf9-ddff-4ec2-a1fd-580a36b2b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:26.307446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bfaf9-ddff-4ec2-a1fd-580a36b2b3df None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:26.307727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bfaf9-ddff-4ec2-a1fd-580a36b2b3df None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:26.308033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bfaf9-ddff-4ec2-a1fd-580a36b2b3df None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:26.308704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bfaf9-ddff-4ec2-a1fd-580a36b2b3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:26.310113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bfaf9-ddff-4ec2-a1fd-580a36b2b3df None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:26.317161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 657/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Tue May 24 09:59:26 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 09:59:28.495106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5960f-2a72-490f-9a27-cb0d0cd4354f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:28.495613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5960f-2a72-490f-9a27-cb0d0cd4354f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:28.495707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5960f-2a72-490f-9a27-cb0d0cd4354f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:28.497101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 645/1302] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 09:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 09:59:28.502411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:28.502814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:28.503459 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:28.520643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 09:59:28.521820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 09:59:28.586961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 658/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 09:59:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 24 09:59:28.609958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5960f-2a72-490f-9a27-cb0d0cd4354f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:28.704046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:28.711357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5960f-2a72-490f-9a27-cb0d0cd4354f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:28.743817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:28.744611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:28.744898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:28.745175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:28.745849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:28.747210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 24 09:59:28.759861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 24 09:59:28.760997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: ERROR keystone.server.flask.application May 24 09:59:28.762321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 646/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Tue May 24 09:59:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 24 09:59:28.767154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:28.841628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:28.863721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfa5fc-bb29-4d4c-a79b-cb4170bedfbc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:28.897435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:28.898087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:28.898370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:28.898645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:28.899341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 09:59:28.899646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:28.901113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f6e86-d655-45b4-a635-22bfc76bdc51 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:28.906085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 659/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Tue May 24 09:59:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 09:59:28.912175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 09:59:29.012053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56cfbb-4a24-4e57-b531-273fd5aa3404 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 09:59:29.044519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd034-817e-4b63-90f5-f2027b3eabce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 09:59:29.045206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd034-817e-4b63-90f5-f2027b3eabce None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 09:59:29.045484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd034-817e-4b63-90f5-f2027b3eabce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 09:59:29.045756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd034-817e-4b63-90f5-f2027b3eabce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 09:59:29.046482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd034-817e-4b63-90f5-f2027b3eabce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 09:59:29.047856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd034-817e-4b63-90f5-f2027b3eabce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 09:59:29.119865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 647/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Tue May 24 09:59:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 09:59:38.903110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=30 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 09:59:39.114983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:30.449791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f5a19-f511-4575-b929-ec32b013cd06 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:30.450302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f5a19-f511-4575-b929-ec32b013cd06 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:30.450388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f5a19-f511-4575-b929-ec32b013cd06 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:30.451911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 660/1307] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:30.457145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a9371-2f95-4b5e-bffd-7918a2b2cff3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:30.457549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a9371-2f95-4b5e-bffd-7918a2b2cff3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:30.457752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a9371-2f95-4b5e-bffd-7918a2b2cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:30.566080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af4a9371-2f95-4b5e-bffd-7918a2b2cff3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:30.566389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af4a9371-2f95-4b5e-bffd-7918a2b2cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:30.823820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 648/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:30.862237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c18d1-67c4-48c1-973b-4aa4c3931c7c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:30.862680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c18d1-67c4-48c1-973b-4aa4c3931c7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:30.863069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c18d1-67c4-48c1-973b-4aa4c3931c7c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:30.864616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 661/1309] 10.222.0.44 () {54 vars in 964 bytes} [Tue May 24 10:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:30.872043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc7394-c352-4034-b151-5fa3bb081e5a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:30.872470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc7394-c352-4034-b151-5fa3bb081e5a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:30.872823 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc7394-c352-4034-b151-5fa3bb081e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:30.958379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0bfc7394-c352-4034-b151-5fa3bb081e5a None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:30.960329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0bfc7394-c352-4034-b151-5fa3bb081e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:30.983398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:31.043128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 649/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Tue May 24 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:05:31.054755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c18d1-67c4-48c1-973b-4aa4c3931c7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:31.056892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e58c18d1-67c4-48c1-973b-4aa4c3931c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:31.176855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c18d1-67c4-48c1-973b-4aa4c3931c7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:31.257317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:31.258240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:31.258640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:31.259050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:31.260857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:31.318761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:31.379119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:31.380852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd355bf7-dd78-4358-9a37-f6efef7cb58e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:31.405588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 662/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:33.912451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a90b-fd0a-479f-9b77-b267e0acae66 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:33.913038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a90b-fd0a-479f-9b77-b267e0acae66 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:33.913186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7a90b-fd0a-479f-9b77-b267e0acae66 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:33.914575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 650/1312] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:33.920368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854437-d25c-4540-ba58-af16fe8edf9c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:33.926961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854437-d25c-4540-ba58-af16fe8edf9c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:33.926961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29854437-d25c-4540-ba58-af16fe8edf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:33.999080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-29854437-d25c-4540-ba58-af16fe8edf9c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:34.000351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-29854437-d25c-4540-ba58-af16fe8edf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:34.103844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 663/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:34.139970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a90b-fd0a-479f-9b77-b267e0acae66 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:34.141522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0c7a90b-fd0a-479f-9b77-b267e0acae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:34.252371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7a90b-fd0a-479f-9b77-b267e0acae66 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:34.326575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:34.329411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:34.330061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:34.330346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:34.330624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:34.332276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:34.449311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:34.451080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89bf59-7359-4471-9870-c1a544a37e20 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:34.471853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 651/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:37.325178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775c697-ac9d-4117-a90c-8456256cfed1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:37.325771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775c697-ac9d-4117-a90c-8456256cfed1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:37.325771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775c697-ac9d-4117-a90c-8456256cfed1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:37.327338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 664/1315] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:37.332419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f89-7896-4f33-8dc1-99d9f48504a6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:37.332864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f89-7896-4f33-8dc1-99d9f48504a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:37.332971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380f89-7896-4f33-8dc1-99d9f48504a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:37.396737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a380f89-7896-4f33-8dc1-99d9f48504a6 None None] MFA Rules not processed for user `0db87d6d048f40f4a549194f75eacc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:37.397901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a380f89-7896-4f33-8dc1-99d9f48504a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:37.448786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:37.492703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 652/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:37.530804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775c697-ac9d-4117-a90c-8456256cfed1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:37.532363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2775c697-ac9d-4117-a90c-8456256cfed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:37.542798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:37.638807 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775c697-ac9d-4117-a90c-8456256cfed1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:37.711820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:37.712397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:37.712683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:37.712960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:37.714606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:37.777352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:37.822543 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:37.824012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfa6d0-066e-4d64-a68c-1776349fd113 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:37.842462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 665/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:40.924130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff78e6-49cf-41c0-9ff1-9c196221511d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:40.924694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff78e6-49cf-41c0-9ff1-9c196221511d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:40.924694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff78e6-49cf-41c0-9ff1-9c196221511d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:40.926052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 653/1318] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:40.931780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678888-b752-4a43-99db-050d59372595 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:40.932233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678888-b752-4a43-99db-050d59372595 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:40.932362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678888-b752-4a43-99db-050d59372595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:40.995699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-78678888-b752-4a43-99db-050d59372595 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:40.996922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-78678888-b752-4a43-99db-050d59372595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:41.091432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 666/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:41.129691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff78e6-49cf-41c0-9ff1-9c196221511d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:41.131409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ccff78e6-49cf-41c0-9ff1-9c196221511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:41.235766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff78e6-49cf-41c0-9ff1-9c196221511d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:41.308145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:41.308792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:41.309080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:41.309357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:41.310985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:41.317756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:41.417724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:41.419163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f2d1-a8b0-406d-be56-ace11df21896 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:41.437927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 654/1320] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:44.625833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f7e47-d0bc-4937-af0c-80da102bd1f5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:44.626358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f7e47-d0bc-4937-af0c-80da102bd1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:44.626471 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f7e47-d0bc-4937-af0c-80da102bd1f5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:44.627749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 667/1321] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:44.633160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bd318-d710-4d44-afd6-408ba453864c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:44.633545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bd318-d710-4d44-afd6-408ba453864c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:44.633798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bd318-d710-4d44-afd6-408ba453864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:44.699676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-463bd318-d710-4d44-afd6-408ba453864c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:44.700838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-463bd318-d710-4d44-afd6-408ba453864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:44.760788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:44.803844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 655/1322] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:44.836578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f7e47-d0bc-4937-af0c-80da102bd1f5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:44.839493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f56f7e47-d0bc-4937-af0c-80da102bd1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:44.858149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:44.942430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f7e47-d0bc-4937-af0c-80da102bd1f5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:45.016503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:45.017066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:45.017347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:45.017621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:45.019241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:45.090804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:45.132559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:45.134049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacda0b4-b623-43cc-8bda-b6253f0a93ff service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:45.152071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 668/1323] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:47.445599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db885d9c-0e85-44f9-be1b-4e8f473f117f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:47.446110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db885d9c-0e85-44f9-be1b-4e8f473f117f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:47.446110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db885d9c-0e85-44f9-be1b-4e8f473f117f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:47.447471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 656/1324] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:47.453240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47610e3-0b05-4415-a55a-af5c6c42d24b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:47.453662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47610e3-0b05-4415-a55a-af5c6c42d24b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:47.453809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47610e3-0b05-4415-a55a-af5c6c42d24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:47.518498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d47610e3-0b05-4415-a55a-af5c6c42d24b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:47.519706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d47610e3-0b05-4415-a55a-af5c6c42d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:47.614280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 669/1325] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:47.650313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db885d9c-0e85-44f9-be1b-4e8f473f117f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:47.651922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-db885d9c-0e85-44f9-be1b-4e8f473f117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:47.752865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db885d9c-0e85-44f9-be1b-4e8f473f117f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:47.824344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:47.824985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:47.825266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:47.825537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:47.827397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:47.843588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:47.937400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:47.938875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9165124-a492-44d1-a3f0-112ba20e1a2d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:47.957207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 657/1326] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:50.227846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dc99b-9146-4c9e-9db6-5a28409783ec None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:50.228393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dc99b-9146-4c9e-9db6-5a28409783ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:50.228393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dc99b-9146-4c9e-9db6-5a28409783ec None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:50.229781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 670/1327] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:50.234997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4680d-095f-4292-b6cc-f5a5a237aa0a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:50.235462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4680d-095f-4292-b6cc-f5a5a237aa0a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:50.235571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4680d-095f-4292-b6cc-f5a5a237aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:50.299536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3df4680d-095f-4292-b6cc-f5a5a237aa0a None None] MFA Rules not processed for user `0db87d6d048f40f4a549194f75eacc51`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:50.300773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3df4680d-095f-4292-b6cc-f5a5a237aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:50.364274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:50.395213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 658/1328] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:05:50.433514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dc99b-9146-4c9e-9db6-5a28409783ec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:50.435194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-410dc99b-9146-4c9e-9db6-5a28409783ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:50.467830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:50.541474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dc99b-9146-4c9e-9db6-5a28409783ec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:50.613595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:50.614242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:50.614525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:50.614802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:50.617022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:50.692921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:50.725227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:50.726861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff060b34-2b53-45c7-82a7-1fac51ed12fb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:50.745077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 671/1329] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:53.411533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc368e-d7f8-46af-adde-f9d7c2ee6a98 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:53.412725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc368e-d7f8-46af-adde-f9d7c2ee6a98 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:53.412914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc368e-d7f8-46af-adde-f9d7c2ee6a98 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:53.414327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 659/1330] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:53.419710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb20c7c-0c6b-402d-b0db-91d81cc2eb3d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:53.420156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb20c7c-0c6b-402d-b0db-91d81cc2eb3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:53.420293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb20c7c-0c6b-402d-b0db-91d81cc2eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:53.486243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1cb20c7c-0c6b-402d-b0db-91d81cc2eb3d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:53.487445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1cb20c7c-0c6b-402d-b0db-91d81cc2eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:53.582029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 672/1331] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:53.618184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc368e-d7f8-46af-adde-f9d7c2ee6a98 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:53.619711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fecc368e-d7f8-46af-adde-f9d7c2ee6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:53.729387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc368e-d7f8-46af-adde-f9d7c2ee6a98 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:53.804636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:53.805293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:53.805577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:53.805849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:53.807539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:53.837454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:53.925436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:53.926914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867dd81-27df-4918-b3d6-7cd661441ebc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:53.947653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 660/1332] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:56.193965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dcf77-50ae-4172-a0f3-db28f361425a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:56.194529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dcf77-50ae-4172-a0f3-db28f361425a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:56.194529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dcf77-50ae-4172-a0f3-db28f361425a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:56.195930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 673/1333] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:56.201202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c5a8-8658-4de8-83e4-f2d8009cb3b6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:56.201607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c5a8-8658-4de8-83e4-f2d8009cb3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:56.201767 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c5a8-8658-4de8-83e4-f2d8009cb3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:56.266036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5fe7c5a8-8658-4de8-83e4-f2d8009cb3b6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:56.267220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fe7c5a8-8658-4de8-83e4-f2d8009cb3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:56.339068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:56.360064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 661/1334] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:56.400050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dcf77-50ae-4172-a0f3-db28f361425a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:56.401580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b5dcf77-50ae-4172-a0f3-db28f361425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:56.442009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:56.510502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dcf77-50ae-4172-a0f3-db28f361425a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:56.584561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:56.585208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:56.585489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:56.585763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:56.587403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:56.672089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:05:56.697472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:05:56.699357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405cd38-d193-458c-a0aa-ce4e0fec120a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:05:56.718030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 674/1335] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:05:59.505240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ecf8-a93a-4b55-bbd6-3d5c084a13a5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:59.505778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ecf8-a93a-4b55-bbd6-3d5c084a13a5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:59.505778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ecf8-a93a-4b55-bbd6-3d5c084a13a5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:59.507296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 662/1336] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:05:59.512481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a18f7-8fbb-4b06-ba09-d7b1a8ad56b9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:59.512888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a18f7-8fbb-4b06-ba09-d7b1a8ad56b9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:59.513039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a18f7-8fbb-4b06-ba09-d7b1a8ad56b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:59.577647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-978a18f7-8fbb-4b06-ba09-d7b1a8ad56b9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:05:59.578830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-978a18f7-8fbb-4b06-ba09-d7b1a8ad56b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:59.673800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 675/1337] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:05:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:05:59.709788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ecf8-a93a-4b55-bbd6-3d5c084a13a5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:05:59.712107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0fe6ecf8-a93a-4b55-bbd6-3d5c084a13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:59.812065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ecf8-a93a-4b55-bbd6-3d5c084a13a5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:05:59.885539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:05:59.886192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:05:59.886474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:05:59.886749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:05:59.888423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:05:59.925244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:00.002589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:00.004189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05001335-5fdf-4fd7-9b98-e45d01715ed6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:00.024090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 663/1338] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:05:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:04.422417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f2da-d948-455c-ad9c-3339ee0c6716 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:04.422966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f2da-d948-455c-ad9c-3339ee0c6716 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:04.422966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06f2da-d948-455c-ad9c-3339ee0c6716 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:04.424359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 676/1339] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:04.430277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc43bc3-8ce8-4bb0-8dc4-d8d5fabef419 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:04.430722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc43bc3-8ce8-4bb0-8dc4-d8d5fabef419 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:04.430889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc43bc3-8ce8-4bb0-8dc4-d8d5fabef419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:04.505587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4bc43bc3-8ce8-4bb0-8dc4-d8d5fabef419 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:04.506787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4bc43bc3-8ce8-4bb0-8dc4-d8d5fabef419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:04.596383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:04.609313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 664/1340] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:04.659372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb792f-c883-4e99-ae95-f88f5a17f78a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:04.659655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb792f-c883-4e99-ae95-f88f5a17f78a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:04.659966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb792f-c883-4e99-ae95-f88f5a17f78a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:04.661333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 677/1341] 10.222.0.44 () {54 vars in 964 bytes} [Tue May 24 10:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:04.667904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a27b4-d477-495d-ab72-3ab0a0083f4f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:04.668206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a27b4-d477-495d-ab72-3ab0a0083f4f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:04.668519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a27b4-d477-495d-ab72-3ab0a0083f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:04.735506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3c4a27b4-d477-495d-ab72-3ab0a0083f4f None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:04.736744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c4a27b4-d477-495d-ab72-3ab0a0083f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:04.816509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 665/1342] 10.222.0.44 () {58 vars in 1061 bytes} [Tue May 24 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:06:04.825393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb792f-c883-4e99-ae95-f88f5a17f78a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:04.838287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb792f-c883-4e99-ae95-f88f5a17f78a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:04.841853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0db61-dee9-414b-8f62-d711283e19aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:04.842565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0db61-dee9-414b-8f62-d711283e19aa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:04.842917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0db61-dee9-414b-8f62-d711283e19aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:04.843263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0db61-dee9-414b-8f62-d711283e19aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:04.853599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0db61-dee9-414b-8f62-d711283e19aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:04.855078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0db61-dee9-414b-8f62-d711283e19aa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:04.865289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 678/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:08.528787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fb059-0b23-49ea-9155-3e59474dd0bc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:08.529385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fb059-0b23-49ea-9155-3e59474dd0bc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:08.529385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fb059-0b23-49ea-9155-3e59474dd0bc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:08.530751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 666/1344] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:08.536032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60648-d2d4-4e7e-ab53-124086bd4251 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:08.536423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60648-d2d4-4e7e-ab53-124086bd4251 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:08.536615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c60648-d2d4-4e7e-ab53-124086bd4251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:08.564148 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-17c60648-d2d4-4e7e-ab53-124086bd4251 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:08.565326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17c60648-d2d4-4e7e-ab53-124086bd4251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:08.583537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:08.641468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 679/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:08.678206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fb059-0b23-49ea-9155-3e59474dd0bc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:08.689596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fb059-0b23-49ea-9155-3e59474dd0bc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:08.693190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaa1d7-552f-4144-b948-67706d5f0e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:08.693778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa1d7-552f-4144-b948-67706d5f0e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:08.694064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa1d7-552f-4144-b948-67706d5f0e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:08.694385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa1d7-552f-4144-b948-67706d5f0e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:08.703679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eaa1d7-552f-4144-b948-67706d5f0e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:08.705161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eaa1d7-552f-4144-b948-67706d5f0e29 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:08.714548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 667/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:13.317532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db578-d325-4076-a248-d50700ffa1e7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:13.318056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db578-d325-4076-a248-d50700ffa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:13.318151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db578-d325-4076-a248-d50700ffa1e7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:13.320103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 680/1347] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:13.325595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95003057-ad32-4895-ba79-7d0e41ef61b6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:13.326061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95003057-ad32-4895-ba79-7d0e41ef61b6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:13.326313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95003057-ad32-4895-ba79-7d0e41ef61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:13.344434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-95003057-ad32-4895-ba79-7d0e41ef61b6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:13.345634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95003057-ad32-4895-ba79-7d0e41ef61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:13.354351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 668/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:13.391573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764db578-d325-4076-a248-d50700ffa1e7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:13.402656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764db578-d325-4076-a248-d50700ffa1e7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:13.406356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a7a92-5c93-45bc-af78-4992f92bb452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:13.407001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a7a92-5c93-45bc-af78-4992f92bb452 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:13.407281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a7a92-5c93-45bc-af78-4992f92bb452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:13.407553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a7a92-5c93-45bc-af78-4992f92bb452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:13.421734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a7a92-5c93-45bc-af78-4992f92bb452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:13.421734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a7a92-5c93-45bc-af78-4992f92bb452 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:13.428498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 681/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:18.754968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51f147-412f-4875-b682-90a66ab09bae None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:18.755870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51f147-412f-4875-b682-90a66ab09bae None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:18.756877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51f147-412f-4875-b682-90a66ab09bae None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:18.758773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 669/1350] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:18.764332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b86bbe-64d9-419c-a957-1531ddc74bd6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:18.764778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b86bbe-64d9-419c-a957-1531ddc74bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:18.764901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b86bbe-64d9-419c-a957-1531ddc74bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:18.848284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b5b86bbe-64d9-419c-a957-1531ddc74bd6 None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:18.850573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5b86bbe-64d9-419c-a957-1531ddc74bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:18.954727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 682/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:23.118907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ffd83-d491-406a-9149-bc80834aa571 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:23.119495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ffd83-d491-406a-9149-bc80834aa571 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:23.119495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ffd83-d491-406a-9149-bc80834aa571 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:23.121153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 670/1352] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:23.126097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d2fa-cb31-4649-8ca8-bc32cca783f3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:23.126574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d2fa-cb31-4649-8ca8-bc32cca783f3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:23.126692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d2fa-cb31-4649-8ca8-bc32cca783f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:23.146103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-08b6d2fa-cb31-4649-8ca8-bc32cca783f3 None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:23.148008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-08b6d2fa-cb31-4649-8ca8-bc32cca783f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:23.156967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 683/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:23.339601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=66 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:24.608659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba3b1-d98d-43d2-9022-e4a14593118b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:24.609274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba3b1-d98d-43d2-9022-e4a14593118b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:24.609274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba3b1-d98d-43d2-9022-e4a14593118b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:24.610709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 671/1354] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:24.616160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc77b1-1d3b-414d-b690-aed8b9b37505 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:24.616637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc77b1-1d3b-414d-b690-aed8b9b37505 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:24.616845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc77b1-1d3b-414d-b690-aed8b9b37505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:24.635719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d6dc77b1-1d3b-414d-b690-aed8b9b37505 None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:24.636951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6dc77b1-1d3b-414d-b690-aed8b9b37505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:24.646059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 684/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:06:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:28.674638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6d18-e819-4831-829b-9973f783ad9b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:28.675175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6d18-e819-4831-829b-9973f783ad9b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:28.675175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6d18-e819-4831-829b-9973f783ad9b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:28.676481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 672/1356] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:28.681660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942c44-4a35-481f-ba6e-999d3c56bed8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:28.682055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942c44-4a35-481f-ba6e-999d3c56bed8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:28.682248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942c44-4a35-481f-ba6e-999d3c56bed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:28.700540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-70942c44-4a35-481f-ba6e-999d3c56bed8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:28.701726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-70942c44-4a35-481f-ba6e-999d3c56bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:28.710879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 685/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:28.762823 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc4e8-d1f4-4af4-a99a-169c6fe3c9a5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:28.763115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc4e8-d1f4-4af4-a99a-169c6fe3c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:28.763397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc4e8-d1f4-4af4-a99a-169c6fe3c9a5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:28.764814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 673/1358] 10.222.0.44 () {54 vars in 961 bytes} [Tue May 24 10:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:28.774960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be761-315d-46a5-9a95-190ed72afe92 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:28.776060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be761-315d-46a5-9a95-190ed72afe92 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:28.776587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6be761-315d-46a5-9a95-190ed72afe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:28.834922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6b6be761-315d-46a5-9a95-190ed72afe92 None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:28.836162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6b6be761-315d-46a5-9a95-190ed72afe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:28.841948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:28.928255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 686/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Tue May 24 10:06:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:06:28.935197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc4e8-d1f4-4af4-a99a-169c6fe3c9a5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:28.950328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc4e8-d1f4-4af4-a99a-169c6fe3c9a5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:28.959609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98118-0f58-482d-9290-711f382d5dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:28.960686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98118-0f58-482d-9290-711f382d5dc6 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:28.961127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98118-0f58-482d-9290-711f382d5dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:28.961683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98118-0f58-482d-9290-711f382d5dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:28.971502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98118-0f58-482d-9290-711f382d5dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:28.973334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98118-0f58-482d-9290-711f382d5dc6 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:28.987964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 674/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:06:31.419687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35964-f828-45cf-bc6e-4074bbd39534 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:31.420287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35964-f828-45cf-bc6e-4074bbd39534 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:31.420287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35964-f828-45cf-bc6e-4074bbd39534 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:31.421808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 687/1361] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:31.426811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a460-4f96-43da-9c16-2a02d380c338 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:31.427215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a460-4f96-43da-9c16-2a02d380c338 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:31.427364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074a460-4f96-43da-9c16-2a02d380c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:31.446210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1074a460-4f96-43da-9c16-2a02d380c338 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:31.448274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1074a460-4f96-43da-9c16-2a02d380c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:31.456324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 675/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:31.501372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35964-f828-45cf-bc6e-4074bbd39534 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:31.518273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35964-f828-45cf-bc6e-4074bbd39534 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:31.524580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6bbc5-bb30-4801-a2e0-ac9e99e993c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:31.525313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6bbc5-bb30-4801-a2e0-ac9e99e993c9 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:31.525662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6bbc5-bb30-4801-a2e0-ac9e99e993c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:31.526008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6bbc5-bb30-4801-a2e0-ac9e99e993c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:31.535246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6bbc5-bb30-4801-a2e0-ac9e99e993c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:31.537968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6bbc5-bb30-4801-a2e0-ac9e99e993c9 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:31.548431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 688/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:34.220140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f886e1-0df5-4905-9707-61a72afd3113 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:34.220683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f886e1-0df5-4905-9707-61a72afd3113 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:34.220683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f886e1-0df5-4905-9707-61a72afd3113 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:34.222047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 676/1364] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:34.227837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25678eb-d36b-4aa6-be40-31e93276acdf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:34.228226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25678eb-d36b-4aa6-be40-31e93276acdf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:34.228430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25678eb-d36b-4aa6-be40-31e93276acdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:34.249282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e25678eb-d36b-4aa6-be40-31e93276acdf None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:34.250859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e25678eb-d36b-4aa6-be40-31e93276acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:34.272516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 689/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:34.307047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496e9b-a851-4307-9c33-2d046825017d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:34.307417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496e9b-a851-4307-9c33-2d046825017d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:34.307771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65496e9b-a851-4307-9c33-2d046825017d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:34.309279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 677/1366] 10.222.0.44 () {54 vars in 961 bytes} [Tue May 24 10:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:34.314682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a66f46-d530-4476-a856-479d67ce4d4f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:34.314973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a66f46-d530-4476-a856-479d67ce4d4f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:34.315254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a66f46-d530-4476-a856-479d67ce4d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:34.335022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80a66f46-d530-4476-a856-479d67ce4d4f None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:34.336238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80a66f46-d530-4476-a856-479d67ce4d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:34.345358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 690/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Tue May 24 10:06:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:34.353132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496e9b-a851-4307-9c33-2d046825017d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:34.367363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65496e9b-a851-4307-9c33-2d046825017d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:34.372748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6adb-578c-43f7-aa60-b4c8adb37e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:34.373469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6adb-578c-43f7-aa60-b4c8adb37e79 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:34.373820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6adb-578c-43f7-aa60-b4c8adb37e79 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:34.374165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6adb-578c-43f7-aa60-b4c8adb37e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:34.382860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6adb-578c-43f7-aa60-b4c8adb37e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:34.384550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6adb-578c-43f7-aa60-b4c8adb37e79 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:34.393872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 678/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:36.796431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4390-7776-477d-949b-c91ba4c88ec9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:36.796987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4390-7776-477d-949b-c91ba4c88ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:36.796987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e4390-7776-477d-949b-c91ba4c88ec9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:36.798289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 691/1369] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:36.804207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3adc3-755c-4449-beee-4e2b4d12db50 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:36.804717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3adc3-755c-4449-beee-4e2b4d12db50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:36.804814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3adc3-755c-4449-beee-4e2b4d12db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:36.822737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bac3adc3-755c-4449-beee-4e2b4d12db50 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:36.823973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bac3adc3-755c-4449-beee-4e2b4d12db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:36.832316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 679/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:36.877258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4390-7776-477d-949b-c91ba4c88ec9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:36.892258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e4390-7776-477d-949b-c91ba4c88ec9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:36.898491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929a894-46de-4785-b41e-77157f97f9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:36.899244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a894-46de-4785-b41e-77157f97f9c6 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:36.899635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a894-46de-4785-b41e-77157f97f9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:36.900044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a894-46de-4785-b41e-77157f97f9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:36.909066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929a894-46de-4785-b41e-77157f97f9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:36.910796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929a894-46de-4785-b41e-77157f97f9c6 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:36.921386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 692/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:36.962069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c613-34a7-44d7-b37b-ab76163e2344 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:36.962477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c613-34a7-44d7-b37b-ab76163e2344 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:36.962760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c613-34a7-44d7-b37b-ab76163e2344 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:36.964184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 680/1372] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 10:06:36.969994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18bae-5454-48ae-9406-6b626b4698a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:36.970525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18bae-5454-48ae-9406-6b626b4698a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:36.979973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e18bae-5454-48ae-9406-6b626b4698a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:36.991115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8e18bae-5454-48ae-9406-6b626b4698a3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:36.992427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8e18bae-5454-48ae-9406-6b626b4698a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:37.004178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 693/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:37.331658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1045-1ec5-469e-a350-5f5347cce2f8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:37.332072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1045-1ec5-469e-a350-5f5347cce2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:37.332358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a1045-1ec5-469e-a350-5f5347cce2f8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:37.334074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 681/1374] 10.222.0.44 () {54 vars in 963 bytes} [Tue May 24 10:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:37.340763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866df99-520d-4d8c-8be7-93ac542a55b4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:37.341056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866df99-520d-4d8c-8be7-93ac542a55b4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:37.341339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866df99-520d-4d8c-8be7-93ac542a55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:37.395686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9866df99-520d-4d8c-8be7-93ac542a55b4 None None] MFA Rules not processed for user `62fe38a03ef04a2baa5ec228d6a8cf97`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:37.397226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9866df99-520d-4d8c-8be7-93ac542a55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:37.471155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 694/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Tue May 24 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:37.479521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1045-1ec5-469e-a350-5f5347cce2f8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:37.491518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a1045-1ec5-469e-a350-5f5347cce2f8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:37.495094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e7e2c-5447-425e-ae75-6be98da267da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:37.504243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7e2c-5447-425e-ae75-6be98da267da service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:37.504605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7e2c-5447-425e-ae75-6be98da267da service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:37.504895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e7e2c-5447-425e-ae75-6be98da267da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:37.515309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7e2c-5447-425e-ae75-6be98da267da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:37.516802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e7e2c-5447-425e-ae75-6be98da267da service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:37.527088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 682/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:39.341581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70896fc-8c00-48d3-8083-13f383595e5e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:39.342205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70896fc-8c00-48d3-8083-13f383595e5e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:39.342205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70896fc-8c00-48d3-8083-13f383595e5e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:39.343586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 695/1377] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:39.349908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91f5e9-d688-4eaa-80fc-f008f0f81245 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:39.350482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91f5e9-d688-4eaa-80fc-f008f0f81245 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:39.350586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91f5e9-d688-4eaa-80fc-f008f0f81245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:39.369633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a91f5e9-d688-4eaa-80fc-f008f0f81245 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:39.370867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a91f5e9-d688-4eaa-80fc-f008f0f81245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:39.378890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 683/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:39.424909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70896fc-8c00-48d3-8083-13f383595e5e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:39.439782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70896fc-8c00-48d3-8083-13f383595e5e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:39.446381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec16e3-67e9-4d68-bc3b-e54a8df5314f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:39.447055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec16e3-67e9-4d68-bc3b-e54a8df5314f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:39.447340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec16e3-67e9-4d68-bc3b-e54a8df5314f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:39.447645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec16e3-67e9-4d68-bc3b-e54a8df5314f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:39.457241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec16e3-67e9-4d68-bc3b-e54a8df5314f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:39.459610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec16e3-67e9-4d68-bc3b-e54a8df5314f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:39.470087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 696/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:41.913077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84737ad5-020e-46bd-b816-2aa690711947 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:41.913640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84737ad5-020e-46bd-b816-2aa690711947 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:41.913640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84737ad5-020e-46bd-b816-2aa690711947 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:41.915003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 684/1380] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:41.920227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897a30-b0b5-4d70-b6d7-c583cab3c681 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:41.920612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897a30-b0b5-4d70-b6d7-c583cab3c681 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:41.920786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897a30-b0b5-4d70-b6d7-c583cab3c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:41.928730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:41.939436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb897a30-b0b5-4d70-b6d7-c583cab3c681 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:41.940928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb897a30-b0b5-4d70-b6d7-c583cab3c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:41.951131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 697/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:41.994719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84737ad5-020e-46bd-b816-2aa690711947 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:42.012169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84737ad5-020e-46bd-b816-2aa690711947 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:42.018300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22c627-90bc-432c-b8a8-3bbb09ee1a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:42.019027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22c627-90bc-432c-b8a8-3bbb09ee1a6d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:42.019391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22c627-90bc-432c-b8a8-3bbb09ee1a6d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:42.019745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22c627-90bc-432c-b8a8-3bbb09ee1a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:42.029769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22c627-90bc-432c-b8a8-3bbb09ee1a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:42.031431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22c627-90bc-432c-b8a8-3bbb09ee1a6d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:42.041632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 685/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:44.416871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c9c7-0497-45c0-a70a-f4761d07ae9f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:44.417389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c9c7-0497-45c0-a70a-f4761d07ae9f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:44.417389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c9c7-0497-45c0-a70a-f4761d07ae9f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:44.418984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 698/1383] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:44.424162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8942ad-eb0b-4e9d-b8b0-c2a3e8a2833f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:44.424607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8942ad-eb0b-4e9d-b8b0-c2a3e8a2833f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:44.424739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8942ad-eb0b-4e9d-b8b0-c2a3e8a2833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:44.448163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-de8942ad-eb0b-4e9d-b8b0-c2a3e8a2833f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:44.449672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-de8942ad-eb0b-4e9d-b8b0-c2a3e8a2833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:44.458287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 686/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:44.500752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28c9c7-0497-45c0-a70a-f4761d07ae9f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:44.515839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28c9c7-0497-45c0-a70a-f4761d07ae9f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:44.528183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae641c0-238b-4f2e-b2c7-0468b1fd7d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:44.528840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae641c0-238b-4f2e-b2c7-0468b1fd7d2e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:44.529129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae641c0-238b-4f2e-b2c7-0468b1fd7d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:44.529409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae641c0-238b-4f2e-b2c7-0468b1fd7d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:44.539246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae641c0-238b-4f2e-b2c7-0468b1fd7d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:44.540915 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae641c0-238b-4f2e-b2c7-0468b1fd7d2e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:44.550739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 699/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:47.000986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a300-5097-4cdb-8d56-42da41038b39 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:47.001586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a300-5097-4cdb-8d56-42da41038b39 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:47.001586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a300-5097-4cdb-8d56-42da41038b39 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:47.002904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 687/1386] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:47.008863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf26cd-6ab2-4ddb-86ff-c9926fd7e803 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:47.009484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf26cd-6ab2-4ddb-86ff-c9926fd7e803 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:47.009484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf26cd-6ab2-4ddb-86ff-c9926fd7e803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:47.028140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e6cf26cd-6ab2-4ddb-86ff-c9926fd7e803 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:47.029336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e6cf26cd-6ab2-4ddb-86ff-c9926fd7e803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:47.037208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 700/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:47.081762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a300-5097-4cdb-8d56-42da41038b39 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:47.096520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a300-5097-4cdb-8d56-42da41038b39 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:47.102614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030bd44-fbe1-4079-b22c-d8b44f3e1576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:47.103249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030bd44-fbe1-4079-b22c-d8b44f3e1576 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:47.103535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030bd44-fbe1-4079-b22c-d8b44f3e1576 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:47.103887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030bd44-fbe1-4079-b22c-d8b44f3e1576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:47.112145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030bd44-fbe1-4079-b22c-d8b44f3e1576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:47.113730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030bd44-fbe1-4079-b22c-d8b44f3e1576 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:47.123782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 688/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:49.476297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891952c-f199-4b07-af66-cf2740921a8b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:49.476926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891952c-f199-4b07-af66-cf2740921a8b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:49.476926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891952c-f199-4b07-af66-cf2740921a8b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:49.478139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 701/1389] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 10:06:49.483339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5170-05c3-403c-97d9-24c1e8e9e79b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:49.483913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5170-05c3-403c-97d9-24c1e8e9e79b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:49.483913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5170-05c3-403c-97d9-24c1e8e9e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:49.502451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e18d5170-05c3-403c-97d9-24c1e8e9e79b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:49.503597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e18d5170-05c3-403c-97d9-24c1e8e9e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:49.512086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 689/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:49.555678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891952c-f199-4b07-af66-cf2740921a8b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:49.570448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891952c-f199-4b07-af66-cf2740921a8b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:49.577837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885b6e6-112a-4959-a073-b9931de3e861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:49.578790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b6e6-112a-4959-a073-b9931de3e861 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:49.579154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b6e6-112a-4959-a073-b9931de3e861 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:49.579520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b6e6-112a-4959-a073-b9931de3e861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:49.591266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885b6e6-112a-4959-a073-b9931de3e861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:49.593399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885b6e6-112a-4959-a073-b9931de3e861 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:49.606271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 702/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:51.950902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49202b-80e8-4cdf-a07d-c4cb33c5b2b7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:51.951506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49202b-80e8-4cdf-a07d-c4cb33c5b2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:51.951506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49202b-80e8-4cdf-a07d-c4cb33c5b2b7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:51.953110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 690/1392] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 10:06:51.958910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314bdf5-5ada-4ab4-bfe0-88690bdf28e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:51.959363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314bdf5-5ada-4ab4-bfe0-88690bdf28e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:51.959623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314bdf5-5ada-4ab4-bfe0-88690bdf28e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:51.977783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f314bdf5-5ada-4ab4-bfe0-88690bdf28e4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:51.978971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f314bdf5-5ada-4ab4-bfe0-88690bdf28e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:51.986788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 703/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:52.032065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49202b-80e8-4cdf-a07d-c4cb33c5b2b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:52.047422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49202b-80e8-4cdf-a07d-c4cb33c5b2b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:52.053069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ec376-af3b-4d24-a080-3d946fda0501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:52.053725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec376-af3b-4d24-a080-3d946fda0501 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:52.054012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec376-af3b-4d24-a080-3d946fda0501 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:52.054290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ec376-af3b-4d24-a080-3d946fda0501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:52.065856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec376-af3b-4d24-a080-3d946fda0501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:52.067467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ec376-af3b-4d24-a080-3d946fda0501 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:52.077468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 691/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:53.540436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98d46-0089-4d8c-8689-2235a8e47169 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:53.541014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98d46-0089-4d8c-8689-2235a8e47169 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:53.541014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98d46-0089-4d8c-8689-2235a8e47169 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:53.542453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 704/1395] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:53.547996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad398e-b002-4824-bbac-c34e34cd45a4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:53.548443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad398e-b002-4824-bbac-c34e34cd45a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:53.548537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad398e-b002-4824-bbac-c34e34cd45a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:53.554719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=52 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:53.566724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-48ad398e-b002-4824-bbac-c34e34cd45a4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:53.568066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-48ad398e-b002-4824-bbac-c34e34cd45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:53.576581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 692/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:06:53.636550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfb12e-9d24-4115-b1ee-093692747eba None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:53.636935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfb12e-9d24-4115-b1ee-093692747eba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:53.637287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfb12e-9d24-4115-b1ee-093692747eba None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:53.638733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 705/1397] 10.222.0.44 () {54 vars in 962 bytes} [Tue May 24 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:53.643711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a9c46-0ae6-445b-8ee1-002ec2c341a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:53.644051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a9c46-0ae6-445b-8ee1-002ec2c341a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:53.644334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a9c46-0ae6-445b-8ee1-002ec2c341a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:53.692938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fb7a9c46-0ae6-445b-8ee1-002ec2c341a3 None None] MFA Rules not processed for user `a711191915364aa7b4436dfbb9844c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:53.694315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb7a9c46-0ae6-445b-8ee1-002ec2c341a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:53.754644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 693/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Tue May 24 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:53.763122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfb12e-9d24-4115-b1ee-093692747eba None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:53.774291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfb12e-9d24-4115-b1ee-093692747eba None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:53.777791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c0cf6-60b3-459a-9e5b-6e36aeea6b1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:53.778420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0cf6-60b3-459a-9e5b-6e36aeea6b1b service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:53.778703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0cf6-60b3-459a-9e5b-6e36aeea6b1b service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:53.778977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0cf6-60b3-459a-9e5b-6e36aeea6b1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:53.787782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c0cf6-60b3-459a-9e5b-6e36aeea6b1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:53.789241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c0cf6-60b3-459a-9e5b-6e36aeea6b1b service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:53.798502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 706/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:06:54.403091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f865d-aec3-4b32-8d13-55017ff0cc3d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.403300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f865d-aec3-4b32-8d13-55017ff0cc3d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.403570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f865d-aec3-4b32-8d13-55017ff0cc3d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.404972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 694/1400] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:54.410135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.410431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.410713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.429236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:54.430420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:54.438791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 707/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:54.466432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094aba1-75b9-4a52-96f0-40ec9355517e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.466849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094aba1-75b9-4a52-96f0-40ec9355517e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.467206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094aba1-75b9-4a52-96f0-40ec9355517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.483649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:54.495527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f084db3-e5e2-4b31-be45-4a07c0d5254e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:54.501601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d7df9-3d79-468e-a0a9-e188f4c8267b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:54.502239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d7df9-3d79-468e-a0a9-e188f4c8267b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.502520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d7df9-3d79-468e-a0a9-e188f4c8267b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.502791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d7df9-3d79-468e-a0a9-e188f4c8267b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.511944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d7df9-3d79-468e-a0a9-e188f4c8267b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:54.513540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d7df9-3d79-468e-a0a9-e188f4c8267b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:54.517371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4094aba1-75b9-4a52-96f0-40ec9355517e None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:54.518575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4094aba1-75b9-4a52-96f0-40ec9355517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:54.523268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 708/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:06:54.587472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 695/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:54.634583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f8c5-db46-47b6-94c0-b5e7fd72beea None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.635098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f8c5-db46-47b6-94c0-b5e7fd72beea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.635207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f8c5-db46-47b6-94c0-b5e7fd72beea None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.636538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 709/1404] 10.222.0.44 () {54 vars in 942 bytes} [Tue May 24 10:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:54.643001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ca71-d2e7-4668-b908-83f3c61e7fac None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.643291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ca71-d2e7-4668-b908-83f3c61e7fac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.643576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ca71-d2e7-4668-b908-83f3c61e7fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.691564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b815ca71-d2e7-4668-b908-83f3c61e7fac None None] MFA Rules not processed for user `e7af6dbe9ff8421f80acf0405be3088c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:54.693217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b815ca71-d2e7-4668-b908-83f3c61e7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:54.706443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:54.772832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 696/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Tue May 24 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:54.782792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f8c5-db46-47b6-94c0-b5e7fd72beea None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:54.796810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f8c5-db46-47b6-94c0-b5e7fd72beea None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:54.802850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef4838-a52a-4055-ae5b-9e79395b2281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:54.803991 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef4838-a52a-4055-ae5b-9e79395b2281 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:54.804359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef4838-a52a-4055-ae5b-9e79395b2281 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:54.804717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef4838-a52a-4055-ae5b-9e79395b2281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:54.814568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef4838-a52a-4055-ae5b-9e79395b2281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:54.816372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef4838-a52a-4055-ae5b-9e79395b2281 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:54.826223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 710/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:06:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:06:56.992091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848154b-77ec-43da-867c-322ce4c076eb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:56.992663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848154b-77ec-43da-867c-322ce4c076eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:56.992663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848154b-77ec-43da-867c-322ce4c076eb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:56.994031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 697/1407] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:06:57.001521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e966-8aac-476f-ac62-2dd1ed3e9ae4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:57.002032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e966-8aac-476f-ac62-2dd1ed3e9ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:57.064460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38e966-8aac-476f-ac62-2dd1ed3e9ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:57.064460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1d38e966-8aac-476f-ac62-2dd1ed3e9ae4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:06:57.064460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1d38e966-8aac-476f-ac62-2dd1ed3e9ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:06:57.064460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 711/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:06:57.084644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848154b-77ec-43da-867c-322ce4c076eb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:06:57.099967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848154b-77ec-43da-867c-322ce4c076eb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:06:57.105616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb339f-3358-425e-8ea2-95caef01b720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:06:57.106332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb339f-3358-425e-8ea2-95caef01b720 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:06:57.106682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb339f-3358-425e-8ea2-95caef01b720 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:06:57.107029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb339f-3358-425e-8ea2-95caef01b720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:06:57.117413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb339f-3358-425e-8ea2-95caef01b720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:06:57.125809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb339f-3358-425e-8ea2-95caef01b720 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:06:57.130643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 698/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:07.016559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=43 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:07:07.127196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=30 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:07:19.580681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ceb4-7123-4f4c-a200-e067f2a7ff13 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:19.581308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ceb4-7123-4f4c-a200-e067f2a7ff13 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:19.581308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ceb4-7123-4f4c-a200-e067f2a7ff13 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:19.582642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 712/1410] 10.222.0.44 () {54 vars in 918 bytes} [Tue May 24 10:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:19.587678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f933ece-218d-4480-985a-4db958daa8fc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:19.588181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f933ece-218d-4480-985a-4db958daa8fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:19.588288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f933ece-218d-4480-985a-4db958daa8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:19.605797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5f933ece-218d-4480-985a-4db958daa8fc None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:19.606978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5f933ece-218d-4480-985a-4db958daa8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:19.615732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 699/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Tue May 24 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:07:19.629526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3402-6489-49fd-9b0d-7e5aea4628db None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:19.629905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3402-6489-49fd-9b0d-7e5aea4628db None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:19.630193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3402-6489-49fd-9b0d-7e5aea4628db None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:19.631531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 713/1412] 10.222.0.44 () {54 vars in 918 bytes} [Tue May 24 10:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 10:07:19.635994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd25a2-eb32-4939-9f34-05dc1e52b511 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:19.636284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd25a2-eb32-4939-9f34-05dc1e52b511 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:19.636561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd25a2-eb32-4939-9f34-05dc1e52b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:19.655364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0bfd25a2-eb32-4939-9f34-05dc1e52b511 None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:19.656565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0bfd25a2-eb32-4939-9f34-05dc1e52b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:19.665745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 700/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Tue May 24 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:22.328860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd93c-bee0-49d6-8e15-1a2243aac757 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:22.329452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd93c-bee0-49d6-8e15-1a2243aac757 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:22.329452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd93c-bee0-49d6-8e15-1a2243aac757 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:22.330787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:22.336606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cd97-a73f-4164-9c2a-32942f28e3a0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:22.337052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cd97-a73f-4164-9c2a-32942f28e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:22.337174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cd97-a73f-4164-9c2a-32942f28e3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:22.356156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d3a7cd97-a73f-4164-9c2a-32942f28e3a0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:22.357359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d3a7cd97-a73f-4164-9c2a-32942f28e3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:22.365064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:22.407275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd93c-bee0-49d6-8e15-1a2243aac757 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:22.421839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd93c-bee0-49d6-8e15-1a2243aac757 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:22.427337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea07d35-b5f5-40ab-ba3f-c3b02a3bfe50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:22.427993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07d35-b5f5-40ab-ba3f-c3b02a3bfe50 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:22.428275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07d35-b5f5-40ab-ba3f-c3b02a3bfe50 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:22.428547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea07d35-b5f5-40ab-ba3f-c3b02a3bfe50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:22.436692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea07d35-b5f5-40ab-ba3f-c3b02a3bfe50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:22.438339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea07d35-b5f5-40ab-ba3f-c3b02a3bfe50 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:22.451847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 715/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:23.413115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf4885-5b7b-4f22-af0d-aebcbd9cf409 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:23.413690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf4885-5b7b-4f22-af0d-aebcbd9cf409 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:23.413832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf4885-5b7b-4f22-af0d-aebcbd9cf409 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:23.415409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:23.420385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea0dd-2a93-49b4-be1e-5e2a588801f3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:23.420798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea0dd-2a93-49b4-be1e-5e2a588801f3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:23.420969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea0dd-2a93-49b4-be1e-5e2a588801f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:23.439372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d39ea0dd-2a93-49b4-be1e-5e2a588801f3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:23.440596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d39ea0dd-2a93-49b4-be1e-5e2a588801f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:23.448576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:23.626513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf4885-5b7b-4f22-af0d-aebcbd9cf409 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:23.641087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf4885-5b7b-4f22-af0d-aebcbd9cf409 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:23.646502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f26eb-3f3d-4091-9f53-d471cfa6f15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:23.647132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f26eb-3f3d-4091-9f53-d471cfa6f15a service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:23.647417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f26eb-3f3d-4091-9f53-d471cfa6f15a service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:23.647696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f26eb-3f3d-4091-9f53-d471cfa6f15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:23.655721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f26eb-3f3d-4091-9f53-d471cfa6f15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:23.657329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f26eb-3f3d-4091-9f53-d471cfa6f15a service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:23.667123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 703/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:24.600385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ca362-2a5f-47ab-bba2-23700a526e86 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:24.600936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ca362-2a5f-47ab-bba2-23700a526e86 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:24.600936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ca362-2a5f-47ab-bba2-23700a526e86 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:24.602299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:24.607190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305f03-86bc-4b87-a08d-4cf14354b608 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:24.607642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305f03-86bc-4b87-a08d-4cf14354b608 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:24.607871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305f03-86bc-4b87-a08d-4cf14354b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:24.625915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-13305f03-86bc-4b87-a08d-4cf14354b608 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:24.627141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13305f03-86bc-4b87-a08d-4cf14354b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:24.635105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:24.787383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ca362-2a5f-47ab-bba2-23700a526e86 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:24.801271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ca362-2a5f-47ab-bba2-23700a526e86 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:24.806642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66e792-88ff-4b95-9466-709102ef0e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:24.807577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e792-88ff-4b95-9466-709102ef0e48 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:24.807900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e792-88ff-4b95-9466-709102ef0e48 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:24.808173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e792-88ff-4b95-9466-709102ef0e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:24.816080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66e792-88ff-4b95-9466-709102ef0e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:24.818271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66e792-88ff-4b95-9466-709102ef0e48 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:24.827694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 718/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:25.731433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f837d3-b509-43eb-8c3a-87d55bfaff46 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:25.731997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f837d3-b509-43eb-8c3a-87d55bfaff46 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:25.731997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f837d3-b509-43eb-8c3a-87d55bfaff46 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:25.733349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:25.738152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6de4-938f-44ad-909d-aa53769bbc5d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:25.738596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6de4-938f-44ad-909d-aa53769bbc5d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:25.738696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c6de4-938f-44ad-909d-aa53769bbc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:25.757283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d49c6de4-938f-44ad-909d-aa53769bbc5d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:25.758460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d49c6de4-938f-44ad-909d-aa53769bbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:25.766034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:25.914817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f837d3-b509-43eb-8c3a-87d55bfaff46 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:25.929813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f837d3-b509-43eb-8c3a-87d55bfaff46 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:25.935203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168dbf-088f-46a1-bb87-6b37be44c925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:25.935866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168dbf-088f-46a1-bb87-6b37be44c925 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:25.936180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168dbf-088f-46a1-bb87-6b37be44c925 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:25.936453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168dbf-088f-46a1-bb87-6b37be44c925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:25.945013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c168dbf-088f-46a1-bb87-6b37be44c925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:25.946597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c168dbf-088f-46a1-bb87-6b37be44c925 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:25.956501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 706/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:26.857696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7dd4-414d-4cf9-83f1-f7014b7a8325 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:26.858256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7dd4-414d-4cf9-83f1-f7014b7a8325 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:26.858256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7dd4-414d-4cf9-83f1-f7014b7a8325 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:26.859620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:26.865044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b7df-1c76-4843-89ea-0c7b61b679e5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:26.865463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b7df-1c76-4843-89ea-0c7b61b679e5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:26.865586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15b7df-1c76-4843-89ea-0c7b61b679e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:26.883679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4a15b7df-1c76-4843-89ea-0c7b61b679e5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:26.884893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a15b7df-1c76-4843-89ea-0c7b61b679e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:26.892904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:07:27.040939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c7dd4-414d-4cf9-83f1-f7014b7a8325 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:27.055373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c7dd4-414d-4cf9-83f1-f7014b7a8325 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:27.060660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4ba68-0688-4b81-83ba-b308f3214c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:27.061280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ba68-0688-4b81-83ba-b308f3214c9e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:27.061559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ba68-0688-4b81-83ba-b308f3214c9e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:27.061831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4ba68-0688-4b81-83ba-b308f3214c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:27.070024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ba68-0688-4b81-83ba-b308f3214c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:27.071673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4ba68-0688-4b81-83ba-b308f3214c9e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:27.081300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 721/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:27.996221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab808c0-95dc-4a19-a63d-5acec93c6a35 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:27.996804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab808c0-95dc-4a19-a63d-5acec93c6a35 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:27.996804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab808c0-95dc-4a19-a63d-5acec93c6a35 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:27.998217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:28.003261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0e5a-e9fc-4dc2-8dbc-d99b05cd9d8f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:28.003664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0e5a-e9fc-4dc2-8dbc-d99b05cd9d8f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:28.003839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0e5a-e9fc-4dc2-8dbc-d99b05cd9d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:28.022833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f23d0e5a-e9fc-4dc2-8dbc-d99b05cd9d8f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:28.024066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f23d0e5a-e9fc-4dc2-8dbc-d99b05cd9d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:28.031896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:28.180652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab808c0-95dc-4a19-a63d-5acec93c6a35 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:28.196728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab808c0-95dc-4a19-a63d-5acec93c6a35 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:28.202161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae42f98-4d77-4eb4-bb57-e153b2b309b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:28.203060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42f98-4d77-4eb4-bb57-e153b2b309b1 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:28.203352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42f98-4d77-4eb4-bb57-e153b2b309b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:28.203632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae42f98-4d77-4eb4-bb57-e153b2b309b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:28.211763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae42f98-4d77-4eb4-bb57-e153b2b309b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:28.213381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae42f98-4d77-4eb4-bb57-e153b2b309b1 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:28.222578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 709/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:29.124758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b6a3-bdf8-452e-bd4f-6f6a9c895c2f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:29.125275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b6a3-bdf8-452e-bd4f-6f6a9c895c2f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:29.125275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b6a3-bdf8-452e-bd4f-6f6a9c895c2f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:29.126582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:29.131580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d63fb-8206-4e38-9555-0539733b9368 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:29.132025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d63fb-8206-4e38-9555-0539733b9368 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:29.132186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d63fb-8206-4e38-9555-0539733b9368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:29.150385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-467d63fb-8206-4e38-9555-0539733b9368 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:29.151560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-467d63fb-8206-4e38-9555-0539733b9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:29.159516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:29.307787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b6a3-bdf8-452e-bd4f-6f6a9c895c2f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:29.322640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b6a3-bdf8-452e-bd4f-6f6a9c895c2f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:29.328162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6907-c7e6-420a-9d85-6ab3a9551044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:29.328823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6907-c7e6-420a-9d85-6ab3a9551044 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:29.329102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6907-c7e6-420a-9d85-6ab3a9551044 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:29.329371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6907-c7e6-420a-9d85-6ab3a9551044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:29.338159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6907-c7e6-420a-9d85-6ab3a9551044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:29.339822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6907-c7e6-420a-9d85-6ab3a9551044 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:29.349541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 724/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:30.306958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf07c-6170-4048-98ef-9f81b4ae2a7e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:30.307475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf07c-6170-4048-98ef-9f81b4ae2a7e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:30.307475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40faf07c-6170-4048-98ef-9f81b4ae2a7e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:30.308854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:30.314097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbac73-a312-4347-bfa7-fd7faddbf8b1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:30.314503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbac73-a312-4347-bfa7-fd7faddbf8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:30.314656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbac73-a312-4347-bfa7-fd7faddbf8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:30.333090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-48dbac73-a312-4347-bfa7-fd7faddbf8b1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:30.334300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-48dbac73-a312-4347-bfa7-fd7faddbf8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:30.342094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:30.490347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faf07c-6170-4048-98ef-9f81b4ae2a7e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:30.507038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40faf07c-6170-4048-98ef-9f81b4ae2a7e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:30.512591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ab02c-d3ff-4285-a8b2-4fc05ce37fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:30.513229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab02c-d3ff-4285-a8b2-4fc05ce37fe5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:30.513519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab02c-d3ff-4285-a8b2-4fc05ce37fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:30.513805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab02c-d3ff-4285-a8b2-4fc05ce37fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:30.522772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ab02c-d3ff-4285-a8b2-4fc05ce37fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:30.524413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ab02c-d3ff-4285-a8b2-4fc05ce37fe5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:30.533847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 712/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:31.450312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb781df-6162-4b01-baf5-3ea6b20ad10b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:31.450759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb781df-6162-4b01-baf5-3ea6b20ad10b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:31.450883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb781df-6162-4b01-baf5-3ea6b20ad10b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:31.452298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:31.458129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158e22f-d818-4eb1-85e6-fe3c6591746a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:31.458542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158e22f-d818-4eb1-85e6-fe3c6591746a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:31.458688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158e22f-d818-4eb1-85e6-fe3c6591746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:31.477135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d158e22f-d818-4eb1-85e6-fe3c6591746a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:31.478348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d158e22f-d818-4eb1-85e6-fe3c6591746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:31.486238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:31.633639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb781df-6162-4b01-baf5-3ea6b20ad10b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:31.649462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb781df-6162-4b01-baf5-3ea6b20ad10b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:31.654713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f84b76-d93a-4751-be51-e1e53baf0758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:31.655341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84b76-d93a-4751-be51-e1e53baf0758 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:31.655622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84b76-d93a-4751-be51-e1e53baf0758 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:31.655931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84b76-d93a-4751-be51-e1e53baf0758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:31.663865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84b76-d93a-4751-be51-e1e53baf0758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:31.665435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f84b76-d93a-4751-be51-e1e53baf0758 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:31.674504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 727/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:33.755598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a066b8-5d65-4507-950e-05bb13811f58 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:33.756167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a066b8-5d65-4507-950e-05bb13811f58 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:33.756167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a066b8-5d65-4507-950e-05bb13811f58 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:33.757471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:33.762886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c98d8-f5ca-48fd-bd92-d45a49891fc9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:33.763275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c98d8-f5ca-48fd-bd92-d45a49891fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:33.763445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c98d8-f5ca-48fd-bd92-d45a49891fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:33.781785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-539c98d8-f5ca-48fd-bd92-d45a49891fc9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:33.782970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-539c98d8-f5ca-48fd-bd92-d45a49891fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:33.791366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:33.830600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a066b8-5d65-4507-950e-05bb13811f58 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:33.841885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a066b8-5d65-4507-950e-05bb13811f58 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:33.845572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f56391-d288-46f1-a287-4685fb7b55c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:33.846250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f56391-d288-46f1-a287-4685fb7b55c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:33.859250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f56391-d288-46f1-a287-4685fb7b55c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:33.859250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f56391-d288-46f1-a287-4685fb7b55c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:33.859250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f56391-d288-46f1-a287-4685fb7b55c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:33.859250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f56391-d288-46f1-a287-4685fb7b55c4 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:33.867381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 715/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:36.203843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077049-152e-4513-898f-d0de4b752c99 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:36.204421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077049-152e-4513-898f-d0de4b752c99 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:36.204421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e077049-152e-4513-898f-d0de4b752c99 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:36.206027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:36.211523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59536ab-f15a-42d3-89ef-975a28a43c0e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:36.211978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59536ab-f15a-42d3-89ef-975a28a43c0e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:36.212121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59536ab-f15a-42d3-89ef-975a28a43c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:36.230923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d59536ab-f15a-42d3-89ef-975a28a43c0e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:36.232163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d59536ab-f15a-42d3-89ef-975a28a43c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:36.240857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:36.277312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e077049-152e-4513-898f-d0de4b752c99 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:36.288796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e077049-152e-4513-898f-d0de4b752c99 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:36.292275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab8076-578d-4722-96d1-7fab07788057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:36.292913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8076-578d-4722-96d1-7fab07788057 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:36.293197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8076-578d-4722-96d1-7fab07788057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:36.293482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab8076-578d-4722-96d1-7fab07788057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:36.302757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab8076-578d-4722-96d1-7fab07788057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:36.304236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab8076-578d-4722-96d1-7fab07788057 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:36.313385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 730/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:38.861843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430c91-c337-4bdb-8551-20dc78d90d01 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:38.862433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430c91-c337-4bdb-8551-20dc78d90d01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:38.862433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430c91-c337-4bdb-8551-20dc78d90d01 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:38.864330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:38.869698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e98c-a37e-4883-9994-d9dc610fb41c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:38.898138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e98c-a37e-4883-9994-d9dc610fb41c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:38.898138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e98c-a37e-4883-9994-d9dc610fb41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:38.898138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b215e98c-a37e-4883-9994-d9dc610fb41c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:38.898138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b215e98c-a37e-4883-9994-d9dc610fb41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:38.900161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:07:38.943644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430c91-c337-4bdb-8551-20dc78d90d01 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:38.955092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430c91-c337-4bdb-8551-20dc78d90d01 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:38.958899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07caf73-b62e-47ae-82f0-32bc20b2b1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:38.959534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caf73-b62e-47ae-82f0-32bc20b2b1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:38.959843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caf73-b62e-47ae-82f0-32bc20b2b1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:38.960125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07caf73-b62e-47ae-82f0-32bc20b2b1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:38.969187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caf73-b62e-47ae-82f0-32bc20b2b1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:38.984164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07caf73-b62e-47ae-82f0-32bc20b2b1d1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:38.984164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 718/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:07:41.395385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872ec4-febf-4f21-add9-97790b487dae None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:41.395995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872ec4-febf-4f21-add9-97790b487dae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:41.395995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872ec4-febf-4f21-add9-97790b487dae None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:41.397669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:41.402992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd5b3-b9a4-4544-9dfd-4d6abbc85cfc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:41.403383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd5b3-b9a4-4544-9dfd-4d6abbc85cfc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:41.403551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd5b3-b9a4-4544-9dfd-4d6abbc85cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:41.420988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6f8bd5b3-b9a4-4544-9dfd-4d6abbc85cfc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:41.422163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f8bd5b3-b9a4-4544-9dfd-4d6abbc85cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:41.430006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:41.468374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9872ec4-febf-4f21-add9-97790b487dae None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:41.479145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9872ec4-febf-4f21-add9-97790b487dae None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:41.482830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a002d8-f80d-447f-94ba-3badc3cc3a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:41.483455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a002d8-f80d-447f-94ba-3badc3cc3a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:41.483737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a002d8-f80d-447f-94ba-3badc3cc3a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:41.484040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a002d8-f80d-447f-94ba-3badc3cc3a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:41.492836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a002d8-f80d-447f-94ba-3badc3cc3a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:41.494257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a002d8-f80d-447f-94ba-3badc3cc3a7e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:41.503415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 733/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:43.746491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9268-6749-4cc9-978d-f33c77c981a0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:43.747009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9268-6749-4cc9-978d-f33c77c981a0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:43.747009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9268-6749-4cc9-978d-f33c77c981a0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:43.748580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:43.753712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb88e-58eb-4229-a605-06bcfb762216 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:43.754278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb88e-58eb-4229-a605-06bcfb762216 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:43.754278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eb88e-58eb-4229-a605-06bcfb762216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:43.771593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-675eb88e-58eb-4229-a605-06bcfb762216 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:43.772797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-675eb88e-58eb-4229-a605-06bcfb762216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:43.780431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:43.818460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b9268-6749-4cc9-978d-f33c77c981a0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:43.829263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b9268-6749-4cc9-978d-f33c77c981a0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:43.832925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab96420-7369-4848-af19-2c06df4be94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:43.833564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96420-7369-4848-af19-2c06df4be94d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:43.833852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96420-7369-4848-af19-2c06df4be94d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:43.834133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96420-7369-4848-af19-2c06df4be94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:43.843044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab96420-7369-4848-af19-2c06df4be94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:43.844506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab96420-7369-4848-af19-2c06df4be94d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:43.854407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 721/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:46.078932 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d94ab8-6b44-4e97-860c-c5a796457363 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:46.079501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d94ab8-6b44-4e97-860c-c5a796457363 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:46.079501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d94ab8-6b44-4e97-860c-c5a796457363 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:46.080911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:46.086810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd3199-7849-4e8f-aed4-a3824bbe8b5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:46.087223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd3199-7849-4e8f-aed4-a3824bbe8b5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:46.087377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd3199-7849-4e8f-aed4-a3824bbe8b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:46.104956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-25bd3199-7849-4e8f-aed4-a3824bbe8b5f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:46.106147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25bd3199-7849-4e8f-aed4-a3824bbe8b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:46.113912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:46.152189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d94ab8-6b44-4e97-860c-c5a796457363 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:46.153864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1d94ab8-6b44-4e97-860c-c5a796457363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:46.166733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d94ab8-6b44-4e97-860c-c5a796457363 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:46.170254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db78e48-02bf-415b-ad52-2e3baae003a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:46.170880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78e48-02bf-415b-ad52-2e3baae003a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:46.171162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78e48-02bf-415b-ad52-2e3baae003a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:46.171438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78e48-02bf-415b-ad52-2e3baae003a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:46.180764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db78e48-02bf-415b-ad52-2e3baae003a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:46.182184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db78e48-02bf-415b-ad52-2e3baae003a0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:46.191943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 736/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:48.424305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a74d1-f1db-4cd7-9b49-6692c94113dd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:48.424953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a74d1-f1db-4cd7-9b49-6692c94113dd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:48.424953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a74d1-f1db-4cd7-9b49-6692c94113dd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:48.426629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:48.431997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3ee43-dc2b-4c68-ab8e-3e2ff3d71e6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:48.432409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3ee43-dc2b-4c68-ab8e-3e2ff3d71e6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:48.432565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3ee43-dc2b-4c68-ab8e-3e2ff3d71e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:48.438546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=70 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:07:48.450834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8c3ee43-dc2b-4c68-ab8e-3e2ff3d71e6d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:48.452269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8c3ee43-dc2b-4c68-ab8e-3e2ff3d71e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:48.461749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:48.498456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a74d1-f1db-4cd7-9b49-6692c94113dd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:48.503884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=73 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:07:48.509787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a74d1-f1db-4cd7-9b49-6692c94113dd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:48.513330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c51c09-75f7-4808-906d-8442867039a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:48.514495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51c09-75f7-4808-906d-8442867039a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:48.514495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51c09-75f7-4808-906d-8442867039a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:48.514686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51c09-75f7-4808-906d-8442867039a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:48.524316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c51c09-75f7-4808-906d-8442867039a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:48.525994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c51c09-75f7-4808-906d-8442867039a0 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:48.536094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 724/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:50.775220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104e7f2-a415-4421-808b-fe066eea22a3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:50.775750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104e7f2-a415-4421-808b-fe066eea22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:50.775750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104e7f2-a415-4421-808b-fe066eea22a3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:50.777086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:50.782378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8247c-efe4-48f2-a965-7da7a910b66d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:50.782821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8247c-efe4-48f2-a965-7da7a910b66d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:50.782928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8247c-efe4-48f2-a965-7da7a910b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:50.800978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d9d8247c-efe4-48f2-a965-7da7a910b66d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:50.802148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d9d8247c-efe4-48f2-a965-7da7a910b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:50.809998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:50.846418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104e7f2-a415-4421-808b-fe066eea22a3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:50.857812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104e7f2-a415-4421-808b-fe066eea22a3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:50.861394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9685c-e504-48b3-ac7a-1e0b28da3e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:50.862081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9685c-e504-48b3-ac7a-1e0b28da3e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:50.862350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9685c-e504-48b3-ac7a-1e0b28da3e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:50.862656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9685c-e504-48b3-ac7a-1e0b28da3e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:50.871612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9685c-e504-48b3-ac7a-1e0b28da3e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:50.873088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9685c-e504-48b3-ac7a-1e0b28da3e5d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:50.882777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 739/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:53.155103 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710ce9-9bee-405a-a80d-b2284aa1f6bb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:53.155677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710ce9-9bee-405a-a80d-b2284aa1f6bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:53.155677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7710ce9-9bee-405a-a80d-b2284aa1f6bb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:53.157067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:53.162347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071505b-a6b6-4cf3-876a-802bde1e8820 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:53.162811 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071505b-a6b6-4cf3-876a-802bde1e8820 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:53.162922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071505b-a6b6-4cf3-876a-802bde1e8820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:53.181023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7071505b-a6b6-4cf3-876a-802bde1e8820 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:53.182220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7071505b-a6b6-4cf3-876a-802bde1e8820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:53.189988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:53.226685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7710ce9-9bee-405a-a80d-b2284aa1f6bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:53.237337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7710ce9-9bee-405a-a80d-b2284aa1f6bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:53.241580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09aa88-f892-418f-83d6-fe5a588a7124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:53.242237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09aa88-f892-418f-83d6-fe5a588a7124 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:53.242524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09aa88-f892-418f-83d6-fe5a588a7124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:53.242800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09aa88-f892-418f-83d6-fe5a588a7124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:53.251691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09aa88-f892-418f-83d6-fe5a588a7124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:53.253155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09aa88-f892-418f-83d6-fe5a588a7124 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:53.263123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 727/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:07:55.473326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803e40-fdcf-4457-8030-c5b64588c85d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:55.473810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803e40-fdcf-4457-8030-c5b64588c85d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:55.473916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36803e40-fdcf-4457-8030-c5b64588c85d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:55.475242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:07:55.480620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683d38-b6bf-4d83-9e54-db126a2d9b50 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:55.481022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683d38-b6bf-4d83-9e54-db126a2d9b50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:55.481179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683d38-b6bf-4d83-9e54-db126a2d9b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:55.498993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d683d38-b6bf-4d83-9e54-db126a2d9b50 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:07:55.500244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d683d38-b6bf-4d83-9e54-db126a2d9b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:07:55.509406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:07:55.545275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803e40-fdcf-4457-8030-c5b64588c85d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:07:55.556606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36803e40-fdcf-4457-8030-c5b64588c85d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:07:55.560704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c57a9-65a6-4a8d-9625-c9c8581af155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:07:55.561776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c57a9-65a6-4a8d-9625-c9c8581af155 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:07:55.562241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c57a9-65a6-4a8d-9625-c9c8581af155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:07:55.562742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c57a9-65a6-4a8d-9625-c9c8581af155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:07:55.574821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c57a9-65a6-4a8d-9625-c9c8581af155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:07:55.576286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c57a9-65a6-4a8d-9625-c9c8581af155 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:07:55.585746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 742/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:08:05.493988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=17 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:08:05.582207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=17 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:08:28.742148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdb40-ba9e-4c14-a685-acdd4253912d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:28.743064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdb40-ba9e-4c14-a685-acdd4253912d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:28.743064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bdb40-ba9e-4c14-a685-acdd4253912d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:28.744698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 729/1471] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:28.749968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3383914-c1fb-4e17-a887-cb33684198e0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:28.750425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3383914-c1fb-4e17-a887-cb33684198e0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:28.750609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3383914-c1fb-4e17-a887-cb33684198e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:28.769622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e3383914-c1fb-4e17-a887-cb33684198e0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:28.770809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e3383914-c1fb-4e17-a887-cb33684198e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:28.778493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 743/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:28.824592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610b28-598e-40b4-bf27-95cbc1f72382 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:28.824887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610b28-598e-40b4-bf27-95cbc1f72382 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:28.825174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25610b28-598e-40b4-bf27-95cbc1f72382 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:28.826539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 730/1473] 10.222.0.44 () {54 vars in 962 bytes} [Tue May 24 10:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:28.832363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabae3-da7d-4935-ae12-71768c187810 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:28.835137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabae3-da7d-4935-ae12-71768c187810 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:28.835137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaabae3-da7d-4935-ae12-71768c187810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:28.850799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fdaabae3-da7d-4935-ae12-71768c187810 None None] MFA Rules not processed for user `a711191915364aa7b4436dfbb9844c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:28.851997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fdaabae3-da7d-4935-ae12-71768c187810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:28.858595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 744/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Tue May 24 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:08:28.865830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610b28-598e-40b4-bf27-95cbc1f72382 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:28.876440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25610b28-598e-40b4-bf27-95cbc1f72382 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:28.880407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48d3d2-ef03-4b2e-9edd-cb51a9bc79b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:28.881039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48d3d2-ef03-4b2e-9edd-cb51a9bc79b7 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:28.881320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48d3d2-ef03-4b2e-9edd-cb51a9bc79b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:28.881594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48d3d2-ef03-4b2e-9edd-cb51a9bc79b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:28.890569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48d3d2-ef03-4b2e-9edd-cb51a9bc79b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:28.892038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48d3d2-ef03-4b2e-9edd-cb51a9bc79b7 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:28.902157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 731/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:08:31.180511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46e314-4d85-47db-afb4-fe2e57e4dfa6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:31.181040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46e314-4d85-47db-afb4-fe2e57e4dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:31.181040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46e314-4d85-47db-afb4-fe2e57e4dfa6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:31.182389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 745/1476] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:31.187466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e7e5-8a7d-4111-aee7-a8a0e8ed102e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:31.187910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e7e5-8a7d-4111-aee7-a8a0e8ed102e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:31.188054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0e7e5-8a7d-4111-aee7-a8a0e8ed102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:31.206437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-69f0e7e5-8a7d-4111-aee7-a8a0e8ed102e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:31.207617 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-69f0e7e5-8a7d-4111-aee7-a8a0e8ed102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:31.215252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 732/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:31.237862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46e314-4d85-47db-afb4-fe2e57e4dfa6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:31.250039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46e314-4d85-47db-afb4-fe2e57e4dfa6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:31.254508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:31.255137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:31.255416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:31.255688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:31.256432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:31.258190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:08:31.258190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:08:31.258190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:08:31.259338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1855-2516-426e-905e-f2d84841e288 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:31.279179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 746/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Tue May 24 10:08:31 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:08:33.506027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39655e3-865d-4ae0-a672-5b4f20ced1c0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:33.506561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39655e3-865d-4ae0-a672-5b4f20ced1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:33.506561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39655e3-865d-4ae0-a672-5b4f20ced1c0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:33.508108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 733/1479] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:33.513247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071c1e-a393-4f6c-864a-75faae2d02aa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:33.513673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071c1e-a393-4f6c-864a-75faae2d02aa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:33.513813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46071c1e-a393-4f6c-864a-75faae2d02aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:33.531831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-46071c1e-a393-4f6c-864a-75faae2d02aa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:33.533162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-46071c1e-a393-4f6c-864a-75faae2d02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:33.540993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 747/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:33.585347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39655e3-865d-4ae0-a672-5b4f20ced1c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:33.599357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39655e3-865d-4ae0-a672-5b4f20ced1c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:33.604673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04798a55-8c6a-4b17-b57b-61fed07a9881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:33.605301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798a55-8c6a-4b17-b57b-61fed07a9881 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:33.605582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798a55-8c6a-4b17-b57b-61fed07a9881 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:33.605857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04798a55-8c6a-4b17-b57b-61fed07a9881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:33.614332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04798a55-8c6a-4b17-b57b-61fed07a9881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:33.615952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04798a55-8c6a-4b17-b57b-61fed07a9881 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:33.625225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 734/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:08:35.999238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4efd9f-fcef-4055-ba83-bfdde33a5161 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:35.999831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4efd9f-fcef-4055-ba83-bfdde33a5161 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:35.999831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4efd9f-fcef-4055-ba83-bfdde33a5161 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:36.001229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 748/1482] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:36.007259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949151-4d39-4132-b649-bea938f4b75c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:36.007722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949151-4d39-4132-b649-bea938f4b75c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:36.007869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949151-4d39-4132-b649-bea938f4b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:36.026198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-68949151-4d39-4132-b649-bea938f4b75c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:36.027383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68949151-4d39-4132-b649-bea938f4b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:36.035825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 735/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:36.071295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4efd9f-fcef-4055-ba83-bfdde33a5161 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:36.082100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4efd9f-fcef-4055-ba83-bfdde33a5161 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:36.085562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96a956-12d7-463a-aaac-2d3e1c80686b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:36.086188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96a956-12d7-463a-aaac-2d3e1c80686b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:36.086466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96a956-12d7-463a-aaac-2d3e1c80686b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:36.086736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96a956-12d7-463a-aaac-2d3e1c80686b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:36.096434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96a956-12d7-463a-aaac-2d3e1c80686b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:36.097863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96a956-12d7-463a-aaac-2d3e1c80686b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:36.107049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 749/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:08:38.347924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3fd6-1b7c-4016-b93e-486c4457006a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:38.348470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3fd6-1b7c-4016-b93e-486c4457006a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:38.348564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3fd6-1b7c-4016-b93e-486c4457006a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:38.349913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 736/1485] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:38.355099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebcb3e-52f0-48d4-af57-d4effe6b47e9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:38.355497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebcb3e-52f0-48d4-af57-d4effe6b47e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:38.355654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebcb3e-52f0-48d4-af57-d4effe6b47e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:38.373666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-48ebcb3e-52f0-48d4-af57-d4effe6b47e9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:38.374859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-48ebcb3e-52f0-48d4-af57-d4effe6b47e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:38.382750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 750/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:38.419818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3fd6-1b7c-4016-b93e-486c4457006a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:38.431095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3fd6-1b7c-4016-b93e-486c4457006a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:38.434737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c85cb4-2e6d-4ae3-92d9-98f75eab6ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:38.435379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c85cb4-2e6d-4ae3-92d9-98f75eab6ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:38.435663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c85cb4-2e6d-4ae3-92d9-98f75eab6ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:38.435979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c85cb4-2e6d-4ae3-92d9-98f75eab6ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:38.445329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c85cb4-2e6d-4ae3-92d9-98f75eab6ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:38.447119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c85cb4-2e6d-4ae3-92d9-98f75eab6ad8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:38.456479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 737/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:08:40.820137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf0e7-9f5c-4680-8084-ea98481f7485 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:40.821947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf0e7-9f5c-4680-8084-ea98481f7485 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:40.821947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bf0e7-9f5c-4680-8084-ea98481f7485 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:40.822172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 751/1488] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:40.827484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815189a-3105-4372-969e-7dc20220bd3d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:40.828230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815189a-3105-4372-969e-7dc20220bd3d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:40.828230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815189a-3105-4372-969e-7dc20220bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:40.848045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c815189a-3105-4372-969e-7dc20220bd3d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:40.849242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c815189a-3105-4372-969e-7dc20220bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:40.857022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 738/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:40.897382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf0e7-9f5c-4680-8084-ea98481f7485 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:40.908598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bf0e7-9f5c-4680-8084-ea98481f7485 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:40.912128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210f613-cf85-4e86-abde-d916eecde886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:40.912761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210f613-cf85-4e86-abde-d916eecde886 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:40.913042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210f613-cf85-4e86-abde-d916eecde886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:40.913315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210f613-cf85-4e86-abde-d916eecde886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:40.922328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210f613-cf85-4e86-abde-d916eecde886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:40.924387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210f613-cf85-4e86-abde-d916eecde886 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:40.933846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 752/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:08:43.548891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0bb0-cf0d-439e-9ab5-2b75bfbffd4a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:43.549475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0bb0-cf0d-439e-9ab5-2b75bfbffd4a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:43.549475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0bb0-cf0d-439e-9ab5-2b75bfbffd4a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:43.550976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 739/1491] 10.222.0.44 () {54 vars in 926 bytes} [Tue May 24 10:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:08:43.556177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef4b43-56be-4d63-8319-f4f529509c2d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:43.556616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef4b43-56be-4d63-8319-f4f529509c2d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:43.556740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef4b43-56be-4d63-8319-f4f529509c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:43.574538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bcef4b43-56be-4d63-8319-f4f529509c2d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:08:43.575712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bcef4b43-56be-4d63-8319-f4f529509c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:08:43.584380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 753/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Tue May 24 10:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:08:43.621869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0bb0-cf0d-439e-9ab5-2b75bfbffd4a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:08:43.633134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0bb0-cf0d-439e-9ab5-2b75bfbffd4a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:08:43.636616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d5613-cd3e-4532-ac46-e12ccd210d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:08:43.637248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d5613-cd3e-4532-ac46-e12ccd210d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:08:43.637530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d5613-cd3e-4532-ac46-e12ccd210d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:08:43.637807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d5613-cd3e-4532-ac46-e12ccd210d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:08:43.646824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d5613-cd3e-4532-ac46-e12ccd210d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:08:43.648290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d5613-cd3e-4532-ac46-e12ccd210d90 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:08:43.657374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 740/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:08:53.569687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=33 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:08:53.653347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=33 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:10:31.042370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.042964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.061382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:10:31.062652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:31.070409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 754/1494] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:10:31.085366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.085872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.085983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.103666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:10:31.104894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:31.112613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 741/1495] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:10:31.117065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.127088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ec79b-9794-4cb1-b046-a8e06129911e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.131465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.132136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.132421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.132697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.133408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:10:31.133709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.134719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.134719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:10:31.134719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:10:31.135609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.147666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 755/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:10:31.155660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.164766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d16e5-7829-4dda-9fa3-75d5838095e2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.169254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.169899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.170690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.170963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.171713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.173468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.173468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:10:31.173468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:10:31.174659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.268640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 742/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:10:31 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:10:31.269641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.279347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35013259-23e9-45fe-aa9e-a53ad4ccba92 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.334891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.335551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.335863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.336145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.336832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.337856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.337856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:10:31.337856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:10:31.339045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.429812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 756/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:10:31 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:10:31.434003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.444861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013de8f1-9b5a-4e78-9464-a3423495bd74 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.449501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.450165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.450448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.450725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.451644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.452698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.452698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:10:31.452698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:10:31.453582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.466514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 743/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:10:31.470579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.480624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3e258-053e-4600-bcef-a260cd7bd934 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.486415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.487070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.487349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.487622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.488381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.489400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.489400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:10:31.489400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:10:31.490266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca9f80-ddc6-4ffb-a1f8-85f360929180 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.503717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 757/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:10:31.507867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.517946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb48fb-9de9-4921-97ce-3cc109cf115b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.522448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.523268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.523550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.523860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] PATH_INFO: `/v3/projects/da29c79b70664204b50133d909fe3078/users/79bad3530f8744b0beb7c46c8f75dad3/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.539308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da29c79b70664204b50133d909fe3078, user_id=79bad3530f8744b0beb7c46c8f75dad3, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.540493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.540493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:10:31.540493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:10:31.542533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f933-88be-4746-ab3b-4e0c229c1ff8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.647122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 744/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:10:31 2022] PUT /identity/v3/projects/da29c79b70664204b50133d909fe3078/users/79bad3530f8744b0beb7c46c8f75dad3/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:10:31.658784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83f34-9265-49d3-8657-066c1bad2311 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.660933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83f34-9265-49d3-8657-066c1bad2311 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.660933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83f34-9265-49d3-8657-066c1bad2311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.685389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d6f83f34-9265-49d3-8657-066c1bad2311 None None] MFA Rules not processed for user `79bad3530f8744b0beb7c46c8f75dad3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:10:31.686740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6f83f34-9265-49d3-8657-066c1bad2311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:31.749412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 758/1502] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:10:31.762371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e48b6-5421-4f34-9415-f604c4bb45e1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.762689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e48b6-5421-4f34-9415-f604c4bb45e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.762970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e48b6-5421-4f34-9415-f604c4bb45e1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.764611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 745/1503] 10.222.0.44 () {54 vars in 963 bytes} [Tue May 24 10:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:10:31.769225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2c3b-9650-4b0f-bf87-a53b9d604686 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.769520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2c3b-9650-4b0f-bf87-a53b9d604686 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.769803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2c3b-9650-4b0f-bf87-a53b9d604686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.787723 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-129d2c3b-9650-4b0f-bf87-a53b9d604686 None None] MFA Rules not processed for user `62fe38a03ef04a2baa5ec228d6a8cf97`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:10:31.788882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-129d2c3b-9650-4b0f-bf87-a53b9d604686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:31.831341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:10:31.838405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 759/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Tue May 24 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:10:31.846729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e48b6-5421-4f34-9415-f604c4bb45e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.859923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e48b6-5421-4f34-9415-f604c4bb45e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.861318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.861940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.862245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.862565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.870680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.872171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:31.880847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 746/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:10:31.923196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7726e-d311-470a-9a29-d85a2f4cff02 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.923512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7726e-d311-470a-9a29-d85a2f4cff02 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.923818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7726e-d311-470a-9a29-d85a2f4cff02 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.925172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 760/1506] 10.222.0.44 () {52 vars in 829 bytes} [Tue May 24 10:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:10:31.928754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:31.990228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83679485-6cf2-42d8-9d4d-d9b4123d4c8e service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:31.994953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:31.995839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:31.996122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:31.996392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] PATH_INFO: `/v3/users/79bad3530f8744b0beb7c46c8f75dad3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:31.997562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bad3530f8744b0beb7c46c8f75dad3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:31.998609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:31.998609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:10:31.998609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:10:31.999821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:32.162866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bad3530f8744b0beb7c46c8f75dad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:32.181597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bad3530f8744b0beb7c46c8f75dad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:32.182517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bad3530f8744b0beb7c46c8f75dad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:32.251748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bad3530f8744b0beb7c46c8f75dad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:32.252411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bad3530f8744b0beb7c46c8f75dad3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:32.261115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:10:32.271518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 747/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:10:31 2022] DELETE /identity/v3/users/79bad3530f8744b0beb7c46c8f75dad3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:10:32.276009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:32.276489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:32.276588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:32.294441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:10:32.295673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:32.354527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 761/1508] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:10:32.363975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:32.365402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:32.420867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598a95-a004-40f1-b983-fff6046afbea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:32.424563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe902a3-fb18-4fb0-b569-66d2a1789aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:32.425217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe902a3-fb18-4fb0-b569-66d2a1789aec service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:32.425501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe902a3-fb18-4fb0-b569-66d2a1789aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:32.425780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe902a3-fb18-4fb0-b569-66d2a1789aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:32.434812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe902a3-fb18-4fb0-b569-66d2a1789aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:32.436857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe902a3-fb18-4fb0-b569-66d2a1789aec service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:32.446293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 748/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:10:32.894758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:10:32.896286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:10:32.908403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce688f-cb48-40bb-bb41-cd2e4ee02efc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:10:32.913102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:10:32.914047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:10:32.914449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:10:32.914740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] PATH_INFO: `/v3/projects/da29c79b70664204b50133d909fe3078` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:10:32.916153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da29c79b70664204b50133d909fe3078)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:10:32.917187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:10:32.917187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:10:32.917187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:10:32.918555 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:10:33.147444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da29c79b70664204b50133d909fe3078', 'request_id': 'req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:33.241284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da29c79b70664204b50133d909fe3078', 'request_id': 'req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:33.256602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da29c79b70664204b50133d909fe3078', 'request_id': 'req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:33.268364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] The token cache is being invalidate because project da29c79b70664204b50133d909fe3078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:10:33.268659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:33.269322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-75d9c3be-a905-4d5e-84fd-2e9f4bfd705e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:10:33.270989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 762/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:10:32 2022] DELETE /identity/v3/projects/da29c79b70664204b50133d909fe3078 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:10:42.442053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=29 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:10:43.265293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:12.915993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000764-9931-4ec6-b610-4dba33c274e1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:12.916608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000764-9931-4ec6-b610-4dba33c274e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:12.916608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000764-9931-4ec6-b610-4dba33c274e1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:12.917921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:12.923227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8b91-c07b-4186-acaf-83285a1b23d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:12.923642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8b91-c07b-4186-acaf-83285a1b23d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:12.923775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8b91-c07b-4186-acaf-83285a1b23d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:12.941466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b93b8b91-c07b-4186-acaf-83285a1b23d9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:12.942655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b93b8b91-c07b-4186-acaf-83285a1b23d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:13.000293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:13.169455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000764-9931-4ec6-b610-4dba33c274e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:13.171123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45000764-9931-4ec6-b610-4dba33c274e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:13.246481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000764-9931-4ec6-b610-4dba33c274e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:13.251934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c612d-65de-4f31-bc5d-18a32ec9df13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:13.252580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c612d-65de-4f31-bc5d-18a32ec9df13 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:13.252866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c612d-65de-4f31-bc5d-18a32ec9df13 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:13.253145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c612d-65de-4f31-bc5d-18a32ec9df13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:13.261221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c612d-65de-4f31-bc5d-18a32ec9df13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:13.263544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c612d-65de-4f31-bc5d-18a32ec9df13 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:13.273204 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 750/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:14.064414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58e1f8-7798-4b4e-a1b7-6c14716c02d9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:14.064983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58e1f8-7798-4b4e-a1b7-6c14716c02d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:14.064983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58e1f8-7798-4b4e-a1b7-6c14716c02d9 None None] PATH_INFO: `/v3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:14.066270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 764/1514] 10.222.0.41 () {54 vars in 925 bytes} [Tue May 24 10:12:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:12:14.073669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:14.074115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:14.074224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:14.093830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:14.095025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:14.147834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132450b-533d-4133-978a-3bfc0bfc18cd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:14.148094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132450b-533d-4133-978a-3bfc0bfc18cd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:14.148344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132450b-533d-4133-978a-3bfc0bfc18cd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:14.149703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 765/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 10:12:14.154985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17904ccd-fc6c-49a3-9305-0c5fde9d045f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:14.155273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17904ccd-fc6c-49a3-9305-0c5fde9d045f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:14.155554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17904ccd-fc6c-49a3-9305-0c5fde9d045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:14.157005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 751/1516] 10.222.0.41 () {58 vars in 1015 bytes} [Tue May 24 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:14.173743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-17904ccd-fc6c-49a3-9305-0c5fde9d045f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:14.174937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17904ccd-fc6c-49a3-9305-0c5fde9d045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:14.182625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 766/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:12:14.338483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:14.350564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c88519-9538-4e2a-ba50-3fe809d1937e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:14.356131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf234744-a779-42a6-8a57-17a99c5e97f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:14.356803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234744-a779-42a6-8a57-17a99c5e97f8 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:14.357088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234744-a779-42a6-8a57-17a99c5e97f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:14.357365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf234744-a779-42a6-8a57-17a99c5e97f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:14.365354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf234744-a779-42a6-8a57-17a99c5e97f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:14.366925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf234744-a779-42a6-8a57-17a99c5e97f8 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:14.376907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 752/1518] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:23.054408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d80df9-2f9d-47d7-b8da-95f7a8c0ccdf None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:23.054964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d80df9-2f9d-47d7-b8da-95f7a8c0ccdf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:23.054964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d80df9-2f9d-47d7-b8da-95f7a8c0ccdf None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:23.056263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 767/1519] 10.222.0.44 () {54 vars in 960 bytes} [Tue May 24 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:23.061509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2777-014d-4061-bf40-0f0fae3b9552 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:23.061970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2777-014d-4061-bf40-0f0fae3b9552 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:23.062113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e2777-014d-4061-bf40-0f0fae3b9552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:23.081389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af3e2777-014d-4061-bf40-0f0fae3b9552 None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:23.082584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af3e2777-014d-4061-bf40-0f0fae3b9552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:23.091016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 753/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Tue May 24 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:23.099080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d80df9-2f9d-47d7-b8da-95f7a8c0ccdf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:23.112215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d80df9-2f9d-47d7-b8da-95f7a8c0ccdf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:23.117063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c83bd4-0713-48bb-b173-495494eb855b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:23.117686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c83bd4-0713-48bb-b173-495494eb855b service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:23.117969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c83bd4-0713-48bb-b173-495494eb855b service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:23.118245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c83bd4-0713-48bb-b173-495494eb855b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:23.126518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c83bd4-0713-48bb-b173-495494eb855b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:23.128120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c83bd4-0713-48bb-b173-495494eb855b service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:23.137406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 768/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:25.637358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd8e87-8ca7-4ae1-a42a-77b6910e1120 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:25.637893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd8e87-8ca7-4ae1-a42a-77b6910e1120 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:25.637893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd8e87-8ca7-4ae1-a42a-77b6910e1120 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:25.639334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:25.644062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514541-b0e6-4da8-8a52-0b50ca667992 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:25.644489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514541-b0e6-4da8-8a52-0b50ca667992 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:25.644624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3514541-b0e6-4da8-8a52-0b50ca667992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:25.662685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f3514541-b0e6-4da8-8a52-0b50ca667992 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:25.663911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3514541-b0e6-4da8-8a52-0b50ca667992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:25.673406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:25.824290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd8e87-8ca7-4ae1-a42a-77b6910e1120 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:25.839819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd8e87-8ca7-4ae1-a42a-77b6910e1120 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:25.845393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee682200-4aaa-4bfb-b1d8-4d3f8942056a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:25.846028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee682200-4aaa-4bfb-b1d8-4d3f8942056a service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:25.846311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee682200-4aaa-4bfb-b1d8-4d3f8942056a service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:25.846586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee682200-4aaa-4bfb-b1d8-4d3f8942056a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:25.854638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee682200-4aaa-4bfb-b1d8-4d3f8942056a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:25.856295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee682200-4aaa-4bfb-b1d8-4d3f8942056a service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:25.866161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 755/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:26.726565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47a3c-5d13-46b9-9209-33df8e536110 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:26.727060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47a3c-5d13-46b9-9209-33df8e536110 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:26.727060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47a3c-5d13-46b9-9209-33df8e536110 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:26.728477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 24 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:26.733353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bc818-b0f9-4bb2-8a68-bec2e91232a6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:26.733800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bc818-b0f9-4bb2-8a68-bec2e91232a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:26.733908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bc818-b0f9-4bb2-8a68-bec2e91232a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:26.751354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5a9bc818-b0f9-4bb2-8a68-bec2e91232a6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:26.752604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5a9bc818-b0f9-4bb2-8a68-bec2e91232a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:26.760205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 24 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:12:26.910821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47a3c-5d13-46b9-9209-33df8e536110 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:26.925926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47a3c-5d13-46b9-9209-33df8e536110 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:26.931197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426288-af99-44a5-b218-39d8f278df13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:26.931846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426288-af99-44a5-b218-39d8f278df13 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:26.932134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426288-af99-44a5-b218-39d8f278df13 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:26.932413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426288-af99-44a5-b218-39d8f278df13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:26.941027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f426288-af99-44a5-b218-39d8f278df13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:26.942601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f426288-af99-44a5-b218-39d8f278df13 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:26.952247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 771/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:31.002595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adaab2-487c-48e7-a262-9662d4ef8f7e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:31.003118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adaab2-487c-48e7-a262-9662d4ef8f7e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:31.003239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adaab2-487c-48e7-a262-9662d4ef8f7e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:31.004587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:31.009871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f897eb8-a246-4c25-a4f0-d1009ecd6040 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:31.010300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f897eb8-a246-4c25-a4f0-d1009ecd6040 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:31.010435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f897eb8-a246-4c25-a4f0-d1009ecd6040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:31.028630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5f897eb8-a246-4c25-a4f0-d1009ecd6040 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:31.029821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f897eb8-a246-4c25-a4f0-d1009ecd6040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:31.037605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:31.073564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adaab2-487c-48e7-a262-9662d4ef8f7e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:31.075297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-86adaab2-487c-48e7-a262-9662d4ef8f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:31.121910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:31.134023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adaab2-487c-48e7-a262-9662d4ef8f7e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:31.137632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe034-14f0-4537-8842-1d9406fc2dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:31.138307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe034-14f0-4537-8842-1d9406fc2dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:31.138594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe034-14f0-4537-8842-1d9406fc2dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:31.138875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe034-14f0-4537-8842-1d9406fc2dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:31.147674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe034-14f0-4537-8842-1d9406fc2dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:31.149136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe034-14f0-4537-8842-1d9406fc2dc2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:31.158827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 758/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:33.338903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379c678-8bef-4f5b-880c-b3965accb305 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:33.339468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379c678-8bef-4f5b-880c-b3965accb305 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:33.339468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379c678-8bef-4f5b-880c-b3965accb305 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:33.340941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:33.346273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cae8-0772-4725-b2a2-c104470c500c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:33.346741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cae8-0772-4725-b2a2-c104470c500c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:33.346862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cae8-0772-4725-b2a2-c104470c500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:33.365476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e306cae8-0772-4725-b2a2-c104470c500c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:33.366660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e306cae8-0772-4725-b2a2-c104470c500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:33.374952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:33.410417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379c678-8bef-4f5b-880c-b3965accb305 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:33.412127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2379c678-8bef-4f5b-880c-b3965accb305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:33.420300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=49 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:33.425879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379c678-8bef-4f5b-880c-b3965accb305 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:33.429399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6001-fb7d-482c-9be0-a7059d29a30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:33.432798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6001-fb7d-482c-9be0-a7059d29a30e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:33.432798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6001-fb7d-482c-9be0-a7059d29a30e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:33.432798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6001-fb7d-482c-9be0-a7059d29a30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:33.441394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6001-fb7d-482c-9be0-a7059d29a30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:33.442941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6001-fb7d-482c-9be0-a7059d29a30e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:33.453290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 774/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:37.204037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b2ee-d58f-4b18-9d6f-a579c9c11eab None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:37.204587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b2ee-d58f-4b18-9d6f-a579c9c11eab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:37.204587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b2ee-d58f-4b18-9d6f-a579c9c11eab None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:37.206256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:37.211761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00492713-6038-401b-a04b-fad273c98d25 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:37.212224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00492713-6038-401b-a04b-fad273c98d25 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:37.212335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00492713-6038-401b-a04b-fad273c98d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:37.230039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00492713-6038-401b-a04b-fad273c98d25 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:37.231258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00492713-6038-401b-a04b-fad273c98d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:37.240618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:12:37.516382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b2ee-d58f-4b18-9d6f-a579c9c11eab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:37.518140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a930b2ee-d58f-4b18-9d6f-a579c9c11eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:37.574568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b2ee-d58f-4b18-9d6f-a579c9c11eab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:37.578124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01549c9-576e-4d38-9d6b-f52893fe1f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:37.578751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01549c9-576e-4d38-9d6b-f52893fe1f05 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:37.579037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01549c9-576e-4d38-9d6b-f52893fe1f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:37.579314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01549c9-576e-4d38-9d6b-f52893fe1f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:37.588561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01549c9-576e-4d38-9d6b-f52893fe1f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:37.590003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01549c9-576e-4d38-9d6b-f52893fe1f05 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:37.599986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 761/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:39.805254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75311c41-5cee-4f9b-a902-738c4b12c838 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:39.805800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75311c41-5cee-4f9b-a902-738c4b12c838 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:39.805800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75311c41-5cee-4f9b-a902-738c4b12c838 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:39.807188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 24 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:12:39.812548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e960f-ec5b-4ba1-861b-ce90b00744d5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:39.812998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e960f-ec5b-4ba1-861b-ce90b00744d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:39.813257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e960f-ec5b-4ba1-861b-ce90b00744d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:39.831246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-624e960f-ec5b-4ba1-861b-ce90b00744d5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:12:39.832475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-624e960f-ec5b-4ba1-861b-ce90b00744d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:39.840140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 24 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:12:40.116652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75311c41-5cee-4f9b-a902-738c4b12c838 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:12:40.118376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75311c41-5cee-4f9b-a902-738c4b12c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:12:40.131843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75311c41-5cee-4f9b-a902-738c4b12c838 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:12:40.135315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86c7d5-3f11-4bbd-bdfe-b76f39032ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:12:40.135982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86c7d5-3f11-4bbd-bdfe-b76f39032ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:12:40.136270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86c7d5-3f11-4bbd-bdfe-b76f39032ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:12:40.136547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86c7d5-3f11-4bbd-bdfe-b76f39032ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:12:40.145251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86c7d5-3f11-4bbd-bdfe-b76f39032ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:12:40.146684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86c7d5-3f11-4bbd-bdfe-b76f39032ac6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:12:40.155935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 777/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:12:49.825729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=39 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:50.151921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=14 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:10.565436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:10.566048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:10.566048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:10.592733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:10.593983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:10.606418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 763/1540] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:10.616860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:10.617424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:10.617424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:10.644895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:10.646321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:10.657871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 778/1541] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:10.662575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:10.677517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533814af-4b71-4888-a94a-a1eb4335251e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:10.695035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:10.695740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:10.696075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:10.696348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:10.697111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:10.697425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:10.698470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:14:10.698470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:14:10.698470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:14:10.699386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:10.720945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 764/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:10.729036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:10.739257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390822a-3574-45d0-b7b1-d1981a6afda2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:10.756547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:10.757237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:10.757661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:10.757947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:10.758641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:10.759676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:14:10.759676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:14:10.759676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:14:10.760926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d3fa6-8b15-4e45-8236-47abbba89bf2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:10.856947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 779/1543] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:10 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:10.861314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:10.873099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef384993-9530-45a2-b739-d693fb25bc89 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:10.949949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:10.950818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:10.951110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:10.951388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:10.952200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:10.953320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:14:10.953320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:14:10.953320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:14:10.954553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:10.961965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcefc-b268-4bdd-8706-838129afb827 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:10.962263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcefc-b268-4bdd-8706-838129afb827 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:10.962666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcefc-b268-4bdd-8706-838129afb827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:10.989935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c55bcefc-b268-4bdd-8706-838129afb827 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:10.991207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c55bcefc-b268-4bdd-8706-838129afb827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.004376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 780/1544] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.013551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.013845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.015961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.036936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.038757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.048832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 765/1545] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:10 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:11.056602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 781/1546] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:11.059923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.061290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.078513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf17e0-a58e-4b26-a803-08e8ae869474 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.081664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e550-2f90-405c-ace3-3fe92146af30 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.089612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.090307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.090595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.090877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.091633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.093870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.095702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.096414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.096699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.096976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.097716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:11.098025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.099683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.125266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 766/1547] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:11.132876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.142111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 782/1548] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:11.148210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee3d5a-0140-43a2-afcc-0e89358b2503 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.150241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.166852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a3a34-72a0-4170-bf63-755fa52e3e3a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.170232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.170923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.171378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.171822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.172622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.174324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.185375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.186089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.186375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.186652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.188513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.189557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.205264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 767/1549] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:11.210013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.231712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f518d-1a05-44f0-a421-9c5cc504c6ec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.246032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730896e-83f9-4f29-9834-66bdf7531fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.246943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730896e-83f9-4f29-9834-66bdf7531fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.247227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730896e-83f9-4f29-9834-66bdf7531fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.247556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730896e-83f9-4f29-9834-66bdf7531fa7 admin admin] PATH_INFO: `/v3/projects/544ebc06855b4435b767c0cc885ec068/users/04058cb7cf374eba92fb7ee796084e20/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.271559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730896e-83f9-4f29-9834-66bdf7531fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=544ebc06855b4435b767c0cc885ec068, user_id=04058cb7cf374eba92fb7ee796084e20, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.274233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730896e-83f9-4f29-9834-66bdf7531fa7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.322054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 783/1550] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:11.326303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.351413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 768/1551] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:11 2022] PUT /identity/v3/projects/544ebc06855b4435b767c0cc885ec068/users/04058cb7cf374eba92fb7ee796084e20/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:11.358236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87f87-10b6-4a3e-9850-50a6a9297b5a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.359091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87f87-10b6-4a3e-9850-50a6a9297b5a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.359326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a87f87-10b6-4a3e-9850-50a6a9297b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.386407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-19a87f87-10b6-4a3e-9850-50a6a9297b5a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.387565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-19a87f87-10b6-4a3e-9850-50a6a9297b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.449176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fcdcf-333d-4e83-8490-3a399832ef24 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.549987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39797e-1d28-4f72-b140-e00974d21ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.550702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39797e-1d28-4f72-b140-e00974d21ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.550992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39797e-1d28-4f72-b140-e00974d21ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.551275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39797e-1d28-4f72-b140-e00974d21ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.552021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39797e-1d28-4f72-b140-e00974d21ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.554015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39797e-1d28-4f72-b140-e00974d21ea4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.626297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 769/1552] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.628108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb5c33-1b71-4820-aafe-5115b8874b60 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.628108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb5c33-1b71-4820-aafe-5115b8874b60 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.628401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb5c33-1b71-4820-aafe-5115b8874b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.651163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3efb5c33-1b71-4820-aafe-5115b8874b60 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.652307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3efb5c33-1b71-4820-aafe-5115b8874b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.660622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 770/1553] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.661851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a5ef-8ec7-4ab1-8e0c-3ad1a15f1883 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.662163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a5ef-8ec7-4ab1-8e0c-3ad1a15f1883 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.662509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8a5ef-8ec7-4ab1-8e0c-3ad1a15f1883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.674792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 784/1554] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/users => generated 290 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:14:11.676157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111cb1-1cde-4e1f-9580-634306fd2627 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.679331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111cb1-1cde-4e1f-9580-634306fd2627 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.679331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d111cb1-1cde-4e1f-9580-634306fd2627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.680745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-03c8a5ef-8ec7-4ab1-8e0c-3ad1a15f1883 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.681987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-03c8a5ef-8ec7-4ab1-8e0c-3ad1a15f1883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.691036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 771/1555] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.692314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef085b6-74f2-4e02-a391-c81c4efc1348 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.692602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef085b6-74f2-4e02-a391-c81c4efc1348 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.692899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef085b6-74f2-4e02-a391-c81c4efc1348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.696000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d111cb1-1cde-4e1f-9580-634306fd2627 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.697205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d111cb1-1cde-4e1f-9580-634306fd2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.706897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 785/1556] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.708381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.708678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.708956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.711906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9ef085b6-74f2-4e02-a391-c81c4efc1348 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.713114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9ef085b6-74f2-4e02-a391-c81c4efc1348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.722211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 772/1557] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.723414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3dbf5-b660-4268-8b4b-9820dfd4afd7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.723738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3dbf5-b660-4268-8b4b-9820dfd4afd7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.724011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3dbf5-b660-4268-8b4b-9820dfd4afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.727708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.728942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.732373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:11.737755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 786/1558] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.740108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.742507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-abf3dbf5-b660-4268-8b4b-9820dfd4afd7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.743673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-abf3dbf5-b660-4268-8b4b-9820dfd4afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.748788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:11.755861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 773/1559] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.757147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.757697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.758164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.780748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.782347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.790478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 774/1560] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.791270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.796722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21826f-4ce5-431b-b4e6-1a10c17b4ec8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.800335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f9786-44b3-4292-bbd0-34978f613109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.800536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11509d3-310d-41a1-b7e8-ae62ae9c1700 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.801032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9786-44b3-4292-bbd0-34978f613109 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.801320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9786-44b3-4292-bbd0-34978f613109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.801590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f9786-44b3-4292-bbd0-34978f613109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.805119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d548036-e79f-4103-afa2-b36673c88c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.805758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548036-e79f-4103-afa2-b36673c88c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.806044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548036-e79f-4103-afa2-b36673c88c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.806322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d548036-e79f-4103-afa2-b36673c88c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.807045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548036-e79f-4103-afa2-b36673c88c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.808770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d548036-e79f-4103-afa2-b36673c88c04 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.810437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f9786-44b3-4292-bbd0-34978f613109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.812415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f9786-44b3-4292-bbd0-34978f613109 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.819583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 775/1561] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:11.820841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1771-bf86-4651-8c17-2468f562544a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.821158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1771-bf86-4651-8c17-2468f562544a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.821442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e1771-bf86-4651-8c17-2468f562544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.824602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 787/1562] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:11.826039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57c59-ec8d-4820-9088-ee7ae7a37fcc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.826337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57c59-ec8d-4820-9088-ee7ae7a37fcc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.826617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57c59-ec8d-4820-9088-ee7ae7a37fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.840694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f11e1771-bf86-4651-8c17-2468f562544a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.841914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f11e1771-bf86-4651-8c17-2468f562544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.848897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-64f57c59-ec8d-4820-9088-ee7ae7a37fcc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.850086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64f57c59-ec8d-4820-9088-ee7ae7a37fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.850857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 776/1563] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.853265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfde8c2-6a99-4b70-878d-e997b34b1d5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.853265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfde8c2-6a99-4b70-878d-e997b34b1d5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.853265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfde8c2-6a99-4b70-878d-e997b34b1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.861933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 788/1564] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.867858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.867858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.867858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.871428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-adfde8c2-6a99-4b70-878d-e997b34b1d5f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.872661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-adfde8c2-6a99-4b70-878d-e997b34b1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.881568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 777/1565] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.882307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.882832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.883125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.883408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.883674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.892762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 789/1566] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.897223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.901619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:11.902760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:11.906686 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d99e56-99ef-451e-b1d8-5e51e796b1c0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.912145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 778/1567] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:11.915587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.915894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.915984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.915984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.915984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.915984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:11.915984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.915984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.922498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad233d-3354-46de-82ea-433b616baf97 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.927460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.928165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.928454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.928733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.929466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.931112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 790/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:11.931246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.932018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.944370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 779/1569] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:11.944512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad6b5-bd10-4cb1-b44b-4b46359eb6bd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.944628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.949179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.949990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.950381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.951126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.951259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:11.951556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.953601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.954904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523aad04-71da-4642-8647-ee0dfb550198 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.959933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.960667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.961027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.961379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.962680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:11.962680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.964122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.969176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 791/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:11.969826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.984073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 780/1571] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:11.984073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:11.984355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52da18c-aa3b-434c-859a-961344374019 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.988626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8b431-30aa-4047-aeeb-eac87db5373d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:11.988832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.989568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.989850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.990128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.990872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:11.991341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.992822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:11.994247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:11.994913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:11.995200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:11.995487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:11.996336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:11.996651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:11.998238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.009582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 792/1572] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:12.010667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.018459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 781/1573] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:12.018459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.027526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289dec-f4bd-4f4a-abe3-a1b51778d5da admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.029370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90032f9-6174-492b-b20d-47ce7dc82086 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.032628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.033394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.033748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.034092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.034477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.034919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.035276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.035553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.035902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.036623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:12.036930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.037225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.038515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.053473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 793/1574] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:12.058417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.064595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c898e4-12ee-4457-8107-3244b75a2beb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.069032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.069928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.070209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.070467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] PATH_INFO: `/v3/projects/8a95b870e08f455ca508bff5b565a8ef/users/e9ca464e9176482f9567d9bf70559844/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.086013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a95b870e08f455ca508bff5b565a8ef, user_id=e9ca464e9176482f9567d9bf70559844, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.091815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:14:12.091815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:14:12.091815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:14:12.091815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.160717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 782/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.160717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.221434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 794/1576] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:12 2022] PUT /identity/v3/projects/8a95b870e08f455ca508bff5b565a8ef/users/e9ca464e9176482f9567d9bf70559844/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:12.229527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.237348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f3805-5cb0-43b0-a684-b14f8541be4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.285676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def835-a7be-44d1-889f-e6dc0199d4e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.290673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.291334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.291625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.291973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.292659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.294023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.294745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.294864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.295142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.295505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.296939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.298777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.311468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:12.377488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 795/1577] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.378466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.385455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:12.401534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 783/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.401534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.472621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484e003-447b-4800-a289-dd30a2182084 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.477599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74470505-7039-4118-9976-c2887754792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.478332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74470505-7039-4118-9976-c2887754792f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.478490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fb51-e02e-45ce-b338-be248c674fe4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.478704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74470505-7039-4118-9976-c2887754792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.478985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74470505-7039-4118-9976-c2887754792f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.479674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74470505-7039-4118-9976-c2887754792f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.481612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74470505-7039-4118-9976-c2887754792f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.485094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.485407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.485703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.485988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.486687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.488645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.582475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 796/1579] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.584279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74470505-7039-4118-9976-c2887754792f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.613325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 784/1580] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.614612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.659132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74470505-7039-4118-9976-c2887754792f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.686005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9020a-dcce-436e-94d7-518573046fc0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.691096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e5cbd-f4f0-4ca4-9efe-78038e383aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.691900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5cbd-f4f0-4ca4-9efe-78038e383aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.692190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5cbd-f4f0-4ca4-9efe-78038e383aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.692466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e5cbd-f4f0-4ca4-9efe-78038e383aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.693280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e5cbd-f4f0-4ca4-9efe-78038e383aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.695193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e5cbd-f4f0-4ca4-9efe-78038e383aa2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.722599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.726831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.726831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.726831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.726831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.726831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.780383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 785/1581] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.785335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.785626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.785907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.813145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] MFA Rules not processed for user `e9ca464e9176482f9567d9bf70559844`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:12.814475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:12.824195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 797/1582] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/projects => generated 405 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:12.825083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.857653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:12.879616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:12.885223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 786/1583] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:12.888900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:12.894843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8faf7-adfb-41cc-85f1-3de97d888c77 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.898370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9fe98-5bb2-4cc5-90cb-beca8ef149d3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:12.899748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.900456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.900736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.901010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.901829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.903177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:12.903751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:12.903894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:12.904128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:12.904409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:12.905087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:12.907058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.032173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 787/1584] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.032397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 798/1585] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:12 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.033091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.033204 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.042950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed931e-ac59-49cc-89dc-d670fdd32009 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.050781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.051439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.051824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.052146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.053388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.054891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.055012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c17ec-7019-4b95-a702-29fb874ec8b6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.067616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.068399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.068691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.068971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.069682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.071650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.159930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 799/1586] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:13 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.160762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.164576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 788/1587] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:13 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.165531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.170533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d738f-54f1-4785-aa35-708fa50b3064 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.175734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc1302-0962-4bb7-b21d-eb4c783ac3e8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.176375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.177039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.177461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.177742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.178464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.180268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.180713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.183628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.183628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.183628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.183628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.184538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.191980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 800/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.195673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.206715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e90db-055a-4fb3-9034-ecb6cd8420e7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.210888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.211741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.212491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.212491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.213259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.215235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.293583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 789/1589] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:13 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.294859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.305948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51632d98-4b70-4a15-9323-c0764597ddde admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.310673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.311336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.315534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.315534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.315534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.315534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.325459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 790/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.326269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.338280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7907-8ec8-4d62-8107-2a492c68fa7b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.343942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 801/1591] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:13 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.344403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.344896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.345556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.346166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.346445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.347176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.349014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.361917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 791/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.361917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.371942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97cba5-5fa0-40ab-be90-91246052560f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.425004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751e8b-19f1-4c51-a4ed-634d67df777e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.430124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.434155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.434155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.434155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.434155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.434521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.450885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 802/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.451726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.463171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.467726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20e254-ab82-4e08-bde9-2ea27b263f9c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.467924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.467924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.467924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.467924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.467924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.469355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.470015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.470357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.470637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.471358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.473042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.479653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 792/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.480455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.485270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 803/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.485970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.491733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edabff8-54f6-4221-814e-4e074ca2a328 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.496073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a794d0-3709-4360-8ec7-691a819f1b9a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.496909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.497638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.497995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.498395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.499243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.501229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.501409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.501936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.502165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.502441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.503290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.505091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.516935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 793/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.516935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.521604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 804/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.521604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.526964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fde54-d96b-421c-995a-61de0edef1fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.532130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3c89-7311-4ff4-abc4-762722c4962b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.532561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.533256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.533543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.533822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.534561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.536459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.536916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.537603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.537854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.538132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.538916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.540823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.552404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 805/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.553778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.563992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9031ab-fb42-47df-9f9c-276045dfe03e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.568800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.569465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.569750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.570174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.570903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.572548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.584339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 806/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.585329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.596119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb915a-556f-4790-a810-4636f901064a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.601222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.601880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.602163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.602437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.603154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.604826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.617845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 807/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.618677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.627378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:13.633066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 794/1601] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:13 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:13.633066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.635984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95cac-ea74-4367-b8bf-8616d29109be admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.641980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.645919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44075a9e-7c89-4f4b-9036-f5e26ab2194b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.648641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.655857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.655857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] PATH_INFO: `/v3/projects/ec0a495fa51c4f038a6d18b3185bcbb0/users/eec86bb8790745aaaa45b6d9e4d94ca7/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.656056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.656056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.656056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.656056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.656374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.656374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.669424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 795/1602] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:13.670356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.677073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0a495fa51c4f038a6d18b3185bcbb0, user_id=eec86bb8790745aaaa45b6d9e4d94ca7, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.681320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e65de-2bae-43d9-be4d-740064492cb4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.681638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.688840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.690255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.690567 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.691597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] PATH_INFO: `/v3/projects/1aeb238c6f4b4c67b876c966b62d3e86/users/663b8de7a75342e28e9d2061efad8305/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.709769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aeb238c6f4b4c67b876c966b62d3e86, user_id=663b8de7a75342e28e9d2061efad8305, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.712486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.759155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 808/1603] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:13 2022] PUT /identity/v3/projects/ec0a495fa51c4f038a6d18b3185bcbb0/users/eec86bb8790745aaaa45b6d9e4d94ca7/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:13.763456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.778933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 796/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:13 2022] PUT /identity/v3/projects/1aeb238c6f4b4c67b876c966b62d3e86/users/663b8de7a75342e28e9d2061efad8305/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:13.779581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:13.799464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:13.847766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab6a8-9d38-4255-8672-78a3334e748f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.848711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2b120-81d4-4f71-a1a6-e9e0eb568d01 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:13.853067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.853870 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:13.854019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.854712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.854863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:13.855025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] PATH_INFO: `/v3/projects/20b9157df136454d83302d24d1768d59/users/06e9e172155548289ca938421d4e32bf/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.855388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:13.855673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] PATH_INFO: `/v3/projects/1305f42b19e14396935cdd8a4e8ba5f9/users/1b79291b8b5d46769f1277bf815a3cce/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:13.872181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1305f42b19e14396935cdd8a4e8ba5f9, user_id=1b79291b8b5d46769f1277bf815a3cce, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.875126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b9157df136454d83302d24d1768d59, user_id=06e9e172155548289ca938421d4e32bf, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:13.875562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.878422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:13.986949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 797/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:13 2022] PUT /identity/v3/projects/1305f42b19e14396935cdd8a4e8ba5f9/users/1b79291b8b5d46769f1277bf815a3cce/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:13.987789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.011691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 809/1606] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:13 2022] PUT /identity/v3/projects/20b9157df136454d83302d24d1768d59/users/06e9e172155548289ca938421d4e32bf/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:14.017379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.091318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3880be-58d6-4470-bcc3-4185f30a2091 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.102215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f834db2-8696-4129-95a6-c8e227d3efb3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.108956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.109921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.110321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.110706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.111603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.113490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:14.124874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 810/1607] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:14.128874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.167766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74faf2e7-ef84-4008-a444-39f7f5dd8b81 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.167766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd2c53-c319-4223-945e-7b6c1a31266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.167766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd2c53-c319-4223-945e-7b6c1a31266a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.167766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd2c53-c319-4223-945e-7b6c1a31266a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.168339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd2c53-c319-4223-945e-7b6c1a31266a admin admin] PATH_INFO: `/v3/projects/059ea34a3c8d43af9a62a65a687b2776/users/db9e5eda74a34c949d52e10f0153f695/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.178020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd2c53-c319-4223-945e-7b6c1a31266a admin admin] RBAC: Authorizing `identity:create_grant(project_id=059ea34a3c8d43af9a62a65a687b2776, user_id=db9e5eda74a34c949d52e10f0153f695, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.187400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd2c53-c319-4223-945e-7b6c1a31266a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:14.217031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a240e1-370b-4bcf-af39-2f6c8a5723f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.222659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a240e1-370b-4bcf-af39-2f6c8a5723f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.223127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a240e1-370b-4bcf-af39-2f6c8a5723f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.224647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a240e1-370b-4bcf-af39-2f6c8a5723f4 admin admin] PATH_INFO: `/v3/projects/117092c933ec4467ac0ad7f900e675fd/users/af64ffaa4eab4c03aaa0693178538994/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.243430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a240e1-370b-4bcf-af39-2f6c8a5723f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117092c933ec4467ac0ad7f900e675fd, user_id=af64ffaa4eab4c03aaa0693178538994, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.250276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a240e1-370b-4bcf-af39-2f6c8a5723f4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:14.274203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 811/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:14 2022] PUT /identity/v3/projects/059ea34a3c8d43af9a62a65a687b2776/users/db9e5eda74a34c949d52e10f0153f695/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:14.276710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74026622-bb4e-4dae-9ee7-b4d5d002c599 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.276866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74026622-bb4e-4dae-9ee7-b4d5d002c599 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.277140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74026622-bb4e-4dae-9ee7-b4d5d002c599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.300812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-74026622-bb4e-4dae-9ee7-b4d5d002c599 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:14.302035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-74026622-bb4e-4dae-9ee7-b4d5d002c599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:14.334055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.352037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 798/1609] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:13 2022] PUT /identity/v3/projects/117092c933ec4467ac0ad7f900e675fd/users/af64ffaa4eab4c03aaa0693178538994/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:14.353435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb800-f304-4b7f-8a8d-671a05955d71 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.355719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb800-f304-4b7f-8a8d-671a05955d71 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.355719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bb800-f304-4b7f-8a8d-671a05955d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.373770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e90bb800-f304-4b7f-8a8d-671a05955d71 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:14.375590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e90bb800-f304-4b7f-8a8d-671a05955d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:14.379025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 812/1610] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:14.379025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.379025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.379025 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.404821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] MFA Rules not processed for user `1b79291b8b5d46769f1277bf815a3cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:14.405644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.406283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:14.457034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 799/1611] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:14.457034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d695a67-0abb-4787-b285-186bf080c6e7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.457034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d695a67-0abb-4787-b285-186bf080c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.457034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d695a67-0abb-4787-b285-186bf080c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.477478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9d695a67-0abb-4787-b285-186bf080c6e7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:14.478936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d695a67-0abb-4787-b285-186bf080c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:14.487939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 813/1612] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:14.489461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.491723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 800/1613] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:14.501934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56d8f-7b95-454c-bef6-19005cd8aec4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.502644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.502937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.503219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.507618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72276ecf-4e61-4198-a563-40d0edcc7847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.508983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276ecf-4e61-4198-a563-40d0edcc7847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.509494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276ecf-4e61-4198-a563-40d0edcc7847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.509971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72276ecf-4e61-4198-a563-40d0edcc7847 admin admin] PATH_INFO: `/v3/projects/09429a2748a84f2aa1188fba0525cc84/users/6639020ad2c5467a9752ae437a57cde3/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.527616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72276ecf-4e61-4198-a563-40d0edcc7847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09429a2748a84f2aa1188fba0525cc84, user_id=6639020ad2c5467a9752ae437a57cde3, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.531288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72276ecf-4e61-4198-a563-40d0edcc7847 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:14.533102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] MFA Rules not processed for user `db9e5eda74a34c949d52e10f0153f695`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:14.534461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:14.591868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 814/1614] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:14 2022] PUT /identity/v3/projects/09429a2748a84f2aa1188fba0525cc84/users/6639020ad2c5467a9752ae437a57cde3/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:14.592372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.592741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.593849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 801/1615] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:14.622412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.632437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] MFA Rules not processed for user `af64ffaa4eab4c03aaa0693178538994`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:14.634414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:14.701186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb65fc-c749-47ea-ad33-a8e434a0a76f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.742126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 815/1616] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:14.748941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.804500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.805186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.805481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.805765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.818936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.855458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.856731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13d17-774c-4266-a8c7-6819db8fff5d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.862009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.862858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.863746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.864074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.925188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.928056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:14.942052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 802/1617] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:14.942853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:14.953983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d6556-864a-4024-9304-55d685541dc6 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:14.963055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:14.963055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:14.963055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:14.963055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:14.963405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.966963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:14.977063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:14.979242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.004014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 816/1618] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:15.005488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.026284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af51869-fd3d-4477-9c26-61569a9d4520 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.030573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.031507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.031929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.032314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.042993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.044704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.056421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 817/1619] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:15.066464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.079872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 803/1620] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:14 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:15.081111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.083230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a013b-bc63-43e1-b9e8-deeee864bd18 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.177278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062a193-4e1a-4926-97ce-7abe87551d5d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.182934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.183825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.184384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.184805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.185778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.188378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.214326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc9c4-77c7-4d43-bc11-51452ec501eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.215034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc9c4-77c7-4d43-bc11-51452ec501eb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.215326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc9c4-77c7-4d43-bc11-51452ec501eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.216567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc9c4-77c7-4d43-bc11-51452ec501eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.216817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc9c4-77c7-4d43-bc11-51452ec501eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.220468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc9c4-77c7-4d43-bc11-51452ec501eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.238012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 818/1621] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:15.239824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43765270-9870-4c71-9381-978db4c24744 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.240201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43765270-9870-4c71-9381-978db4c24744 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.241392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43765270-9870-4c71-9381-978db4c24744 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.243098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 819/1622] 10.222.0.44 () {54 vars in 961 bytes} [Tue May 24 10:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:15.244491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43765270-9870-4c71-9381-978db4c24744 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.261121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43765270-9870-4c71-9381-978db4c24744 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.268226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9112d-5066-4f89-bba8-949452ea755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.269104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9112d-5066-4f89-bba8-949452ea755e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.270327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9112d-5066-4f89-bba8-949452ea755e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.270838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9112d-5066-4f89-bba8-949452ea755e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.271643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9112d-5066-4f89-bba8-949452ea755e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.273973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9112d-5066-4f89-bba8-949452ea755e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.296316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 804/1623] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:15 2022] POST /identity/v3/projects => generated 403 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:15.301367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.366018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 820/1624] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:15 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:15.368790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.372118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.373489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.423889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:15.425867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:15.426053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7891207-7eb3-4425-b0f5-76ac510b925f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.448168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.450667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.450667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.450667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] PATH_INFO: `/v3/projects/09429a2748a84f2aa1188fba0525cc84/users/6639020ad2c5467a9752ae437a57cde3/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.452984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09429a2748a84f2aa1188fba0525cc84, user_id=6639020ad2c5467a9752ae437a57cde3, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.455932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.483832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 805/1625] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:15 2022] PUT /identity/v3/projects/09429a2748a84f2aa1188fba0525cc84/users/6639020ad2c5467a9752ae437a57cde3/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:15.484789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.524582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:15.555770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:15.589100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c97ca6-9b93-4d4d-b39f-79c5b0506bd1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.595195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.596108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.596460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.596858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.597740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.600010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.636607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 821/1626] 10.222.0.44 () {58 vars in 1058 bytes} [Tue May 24 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:15.637736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.652902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5263f6a-28e0-4677-a8eb-9dd921054964 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.660704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929fd38-0855-4887-97e5-9cbbfe9c4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.661407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929fd38-0855-4887-97e5-9cbbfe9c4cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.662496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929fd38-0855-4887-97e5-9cbbfe9c4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.663019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929fd38-0855-4887-97e5-9cbbfe9c4cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.663812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929fd38-0855-4887-97e5-9cbbfe9c4cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.667228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929fd38-0855-4887-97e5-9cbbfe9c4cfc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.679932 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 822/1627] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:15.681252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.681635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.681972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.706354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 806/1628] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:15 2022] POST /identity/v3/users => generated 308 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:15.707451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.759690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] MFA Rules not processed for user `6639020ad2c5467a9752ae437a57cde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:15.761078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:15.886188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd705c-17d7-4963-9a35-4846fa49e2a9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.898749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.899962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.900476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.901384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.917365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 823/1629] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:15.918215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:15.937863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e357c-6681-4a07-af19-1c05414571a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:15.946918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:15.949410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:15.950226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:15.950763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] PATH_INFO: `/v3/projects/0957b700800c4b3687fffdf28c2b0064/users/f19283a76f0f47d28a4b007e1a6b8cfe/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:15.972865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0957b700800c4b3687fffdf28c2b0064, user_id=f19283a76f0f47d28a4b007e1a6b8cfe, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:15.976833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:15.997373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.000998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.016527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 807/1630] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:16.017528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.028931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c910d9-0947-45f0-a537-845b14873e0e service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.036307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.037134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.037423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.037778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.038655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.040267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.057890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 808/1631] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:16.059516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.093945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 824/1632] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:15 2022] PUT /identity/v3/projects/0957b700800c4b3687fffdf28c2b0064/users/f19283a76f0f47d28a4b007e1a6b8cfe/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:16.094632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.211703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:16.220325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef539a1-4537-4972-9495-26bf7a183481 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.292190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be6b8-2186-4cac-b7ae-ff000bdba7d5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.302819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.305123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.306799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.306944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] PATH_INFO: `/v3/projects/2e6b29c53aa8429ebe5bdd3d5d606fcc/users/7338ceedd92c45d1bc492fd6822b2f16/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.339743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805be2c-8afa-4ed0-9a9b-34f0f81dfe2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.345557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805be2c-8afa-4ed0-9a9b-34f0f81dfe2a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.345557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805be2c-8afa-4ed0-9a9b-34f0f81dfe2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.345557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805be2c-8afa-4ed0-9a9b-34f0f81dfe2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.358330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6b29c53aa8429ebe5bdd3d5d606fcc, user_id=7338ceedd92c45d1bc492fd6822b2f16, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.367186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.481465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 825/1633] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:16 2022] PUT /identity/v3/projects/2e6b29c53aa8429ebe5bdd3d5d606fcc/users/7338ceedd92c45d1bc492fd6822b2f16/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:16.482418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.503717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:16.556306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805be2c-8afa-4ed0-9a9b-34f0f81dfe2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.557728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805be2c-8afa-4ed0-9a9b-34f0f81dfe2a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.588250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 809/1634] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:16.589749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba937-9091-492a-bfd1-ed558d932733 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.590063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba937-9091-492a-bfd1-ed558d932733 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.590346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ba937-9091-492a-bfd1-ed558d932733 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.596164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 810/1635] 10.222.0.44 () {54 vars in 912 bytes} [Tue May 24 10:14:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:16.597286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba937-9091-492a-bfd1-ed558d932733 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.599234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1de2c7-2478-4c6b-b5c2-f9a8885d8845 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.605255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2d92-6b13-4e2f-b9f1-c1a589d1da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.606010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2d92-6b13-4e2f-b9f1-c1a589d1da2a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.606211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2d92-6b13-4e2f-b9f1-c1a589d1da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.607032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2d92-6b13-4e2f-b9f1-c1a589d1da2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.607284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2d92-6b13-4e2f-b9f1-c1a589d1da2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.610030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2d92-6b13-4e2f-b9f1-c1a589d1da2a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.627460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 826/1636] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:16.630382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410853-e2a9-4fa0-b6f7-0bb8d73ccf4d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.630681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410853-e2a9-4fa0-b6f7-0bb8d73ccf4d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.630958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410853-e2a9-4fa0-b6f7-0bb8d73ccf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.641065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ba937-9091-492a-bfd1-ed558d932733 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.652078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bb410853-e2a9-4fa0-b6f7-0bb8d73ccf4d None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:16.653475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb410853-e2a9-4fa0-b6f7-0bb8d73ccf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:16.657951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.658637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.658964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.659238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.660091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.661697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.687841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 811/1637] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:16.689755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.736175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091388-ea04-4bd6-9e1a-a1a29166357f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.751674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.756447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.756447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.756447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] PATH_INFO: `/v3/projects/0957b700800c4b3687fffdf28c2b0064/users/f19283a76f0f47d28a4b007e1a6b8cfe/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.759757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0957b700800c4b3687fffdf28c2b0064, user_id=f19283a76f0f47d28a4b007e1a6b8cfe, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.762785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:16.790834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 812/1638] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:16 2022] PUT /identity/v3/projects/0957b700800c4b3687fffdf28c2b0064/users/f19283a76f0f47d28a4b007e1a6b8cfe/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:16.792399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:16.923307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 827/1639] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:14:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:16.940029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.940843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.945818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.978021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553fbf4-79ea-43e2-98f6-01492dd00dd8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:16.984543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:16.985454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:16.985733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:16.986007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] PATH_INFO: `/v3/projects/2e6b29c53aa8429ebe5bdd3d5d606fcc/users/7338ceedd92c45d1bc492fd6822b2f16/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:16.988656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6b29c53aa8429ebe5bdd3d5d606fcc, user_id=7338ceedd92c45d1bc492fd6822b2f16, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:16.992188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:17.009343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 813/1640] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:16 2022] PUT /identity/v3/projects/2e6b29c53aa8429ebe5bdd3d5d606fcc/users/7338ceedd92c45d1bc492fd6822b2f16/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:17.016978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:17.017829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] MFA Rules not processed for user `f19283a76f0f47d28a4b007e1a6b8cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:17.020218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:17.044235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:17.167481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68affd-c531-40ad-bed2-c49832cbef3e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:17.171787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5264b-a4d9-423f-bf26-caf4953b4cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:17.172508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5264b-a4d9-423f-bf26-caf4953b4cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:17.172798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5264b-a4d9-423f-bf26-caf4953b4cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:17.173075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5264b-a4d9-423f-bf26-caf4953b4cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:17.217994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 828/1641] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:17.219475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:17.235147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a829e2-c012-4ab4-b20e-ceac670f629e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:17.240247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac5ac-10c6-4758-af3b-a12b158d4962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:17.241304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac5ac-10c6-4758-af3b-a12b158d4962 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:17.242122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac5ac-10c6-4758-af3b-a12b158d4962 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:17.242613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac5ac-10c6-4758-af3b-a12b158d4962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:17.270885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:17.300064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5264b-a4d9-423f-bf26-caf4953b4cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:17.301528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5264b-a4d9-423f-bf26-caf4953b4cc5 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:17.324596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 814/1642] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:17.329197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a221a-ba00-4edb-ac71-7d91becce228 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:17.329497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a221a-ba00-4edb-ac71-7d91becce228 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:17.332188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a221a-ba00-4edb-ac71-7d91becce228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:17.337294 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac5ac-10c6-4758-af3b-a12b158d4962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:17.338861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac5ac-10c6-4758-af3b-a12b158d4962 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:17.362182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 829/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:17.395314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-223a221a-ba00-4edb-ac71-7d91becce228 None None] MFA Rules not processed for user `7338ceedd92c45d1bc492fd6822b2f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:17.397831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-223a221a-ba00-4edb-ac71-7d91becce228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:17.527064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bd60a-fb1c-49a3-98c7-a860a56229bf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:17.527839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bd60a-fb1c-49a3-98c7-a860a56229bf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:17.528383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bd60a-fb1c-49a3-98c7-a860a56229bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:17.553478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 815/1644] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:17.584790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f4bd60a-fb1c-49a3-98c7-a860a56229bf None None] MFA Rules not processed for user `663b8de7a75342e28e9d2061efad8305`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:17.586838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f4bd60a-fb1c-49a3-98c7-a860a56229bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:17.730382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 830/1645] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:18.029074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336067-3443-4753-9d7e-29670e351eb6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.029074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336067-3443-4753-9d7e-29670e351eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.029074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336067-3443-4753-9d7e-29670e351eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.029074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-46336067-3443-4753-9d7e-29670e351eb6 None None] MFA Rules not processed for user `663b8de7a75342e28e9d2061efad8305`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:18.029074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46336067-3443-4753-9d7e-29670e351eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:18.029074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 816/1646] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:18.031155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc820a60-0aff-4463-922d-329ebf5dad7f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.031155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc820a60-0aff-4463-922d-329ebf5dad7f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.031155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc820a60-0aff-4463-922d-329ebf5dad7f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.031155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 831/1647] 10.222.0.44 () {54 vars in 961 bytes} [Tue May 24 10:14:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:18.034457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.034457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.034457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.034457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:18.034457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:18.034457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 817/1648] 10.222.0.44 () {58 vars in 1058 bytes} [Tue May 24 10:14:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:18.040070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc820a60-0aff-4463-922d-329ebf5dad7f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:18.040070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc820a60-0aff-4463-922d-329ebf5dad7f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:18.040070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd649d-32c3-4c52-9133-3f7b1b826a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:18.040070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd649d-32c3-4c52-9133-3f7b1b826a99 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.040530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd649d-32c3-4c52-9133-3f7b1b826a99 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.040530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd649d-32c3-4c52-9133-3f7b1b826a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.040530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd649d-32c3-4c52-9133-3f7b1b826a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:18.040530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd649d-32c3-4c52-9133-3f7b1b826a99 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:18.040530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 832/1649] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:18.222009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:18.235087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bde06-00de-4077-98d6-55e2ac06f460 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:18.244966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716c20c-3959-427b-8e4b-236b5ed2ec61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:18.245639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716c20c-3959-427b-8e4b-236b5ed2ec61 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.245926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716c20c-3959-427b-8e4b-236b5ed2ec61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.246201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716c20c-3959-427b-8e4b-236b5ed2ec61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.270914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716c20c-3959-427b-8e4b-236b5ed2ec61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:18.272522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716c20c-3959-427b-8e4b-236b5ed2ec61 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:18.293641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 818/1650] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:18.419769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dd854-723d-441f-8db8-ec063174ba92 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.420076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dd854-723d-441f-8db8-ec063174ba92 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.420357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015dd854-723d-441f-8db8-ec063174ba92 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.422404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 833/1651] 10.222.0.44 () {54 vars in 912 bytes} [Tue May 24 10:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:18.429848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.430550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.431212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.450604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:18.481765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:18.489157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:18.493094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015dd854-723d-441f-8db8-ec063174ba92 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:18.509248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015dd854-723d-441f-8db8-ec063174ba92 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:18.513839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 819/1652] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:14:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:18.526806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:18.538404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:18.538541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:18.538541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.538541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.538869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.572342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:18.578840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:18.619547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 834/1653] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:18.695251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37508d-7ce5-48af-87f0-1d46d41f85b3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:18.706356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a88f9-3d3f-40df-941f-11fd09e37b9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:18.707117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a88f9-3d3f-40df-941f-11fd09e37b9c service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:18.707473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a88f9-3d3f-40df-941f-11fd09e37b9c service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:18.707844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a88f9-3d3f-40df-941f-11fd09e37b9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:18.730648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a88f9-3d3f-40df-941f-11fd09e37b9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:18.737790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a88f9-3d3f-40df-941f-11fd09e37b9c service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:18.768674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 820/1654] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:19.673055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:19.845434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee275b1-8a24-42fa-b6bc-3c5be152bf1e service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:19.866474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:19.867589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:19.867728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:19.868263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] PATH_INFO: `/v3/users/db9e5eda74a34c949d52e10f0153f695` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:19.869926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9e5eda74a34c949d52e10f0153f695)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:19.871083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: WARNING py.warnings [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:14:19.871083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: warnings.warn(msg) May 24 10:14:19.871083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: May 24 10:14:19.872615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:19.960372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc07cc-723e-446a-8c28-a4accc3759d5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:19.961127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc07cc-723e-446a-8c28-a4accc3759d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:19.961565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc07cc-723e-446a-8c28-a4accc3759d5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:19.963206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 821/1655] 10.222.0.44 () {54 vars in 912 bytes} [Tue May 24 10:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 24 10:14:19.973785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:19.973785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:19.973785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:20.045009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:20.046587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:20.073970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:20.228835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 822/1656] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:20.240885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9e5eda74a34c949d52e10f0153f695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:20.291404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9e5eda74a34c949d52e10f0153f695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:20.293592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9e5eda74a34c949d52e10f0153f695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:20.302248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9e5eda74a34c949d52e10f0153f695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:20.417460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:20.427016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9f015f2-c25a-46da-a9d6-473b5b0a2604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9e5eda74a34c949d52e10f0153f695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:20.431510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452cc61-82d8-474f-8331-7c28485d29d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:20.454684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:20.456316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:20.460467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:20.460814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:20.474052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:20.477277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 835/1657] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:19 2022] DELETE /identity/v3/users/db9e5eda74a34c949d52e10f0153f695 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:20.479088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e7ee-a64e-4fe0-9d3c-f35ec7bff7ea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:20.479315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e7ee-a64e-4fe0-9d3c-f35ec7bff7ea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:20.479601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e7ee-a64e-4fe0-9d3c-f35ec7bff7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:20.515900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:20.520105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:20.552763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 823/1658] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:14:20.556904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f858e7ee-a64e-4fe0-9d3c-f35ec7bff7ea None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:20.559323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f858e7ee-a64e-4fe0-9d3c-f35ec7bff7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:20.693569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 836/1659] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:20.717039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:20.718459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:20.730058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcf555-c022-457d-8ba1-8f7259319485 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:20.849389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:20.852425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:20.853477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:20.853963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:20.881909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09b0e-40c2-4c65-b8e0-b6d191d4bf04 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:20.882388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09b0e-40c2-4c65-b8e0-b6d191d4bf04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:20.883353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d09b0e-40c2-4c65-b8e0-b6d191d4bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:20.885552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:20.887014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:20.926235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 824/1660] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:20.926422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-27d09b0e-40c2-4c65-b8e0-b6d191d4bf04 None None] MFA Rules not processed for user `04058cb7cf374eba92fb7ee796084e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:20.928022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27d09b0e-40c2-4c65-b8e0-b6d191d4bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:20.982827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:20.982827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.019002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fc6b3-d876-477f-9182-be072326b9c9 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:21.031145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:21.032656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.032948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.033225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] PATH_INFO: `/v3/users/1b79291b8b5d46769f1277bf815a3cce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.037445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b79291b8b5d46769f1277bf815a3cce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:21.044414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:21.064559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 837/1661] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:21.078710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.079230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.079854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.114604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] MFA Rules not processed for user `04058cb7cf374eba92fb7ee796084e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:21.116225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.126020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 838/1662] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:21.255358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:21.256936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.368379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089135c-e9d6-4bd1-bf23-6ac8d076bcc9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:21.369786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:21.393089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b79291b8b5d46769f1277bf815a3cce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:21.400040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7e962-d234-4d7d-aaf6-db0d77e03999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:21.400902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e962-d234-4d7d-aaf6-db0d77e03999 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.401191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e962-d234-4d7d-aaf6-db0d77e03999 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.401466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7e962-d234-4d7d-aaf6-db0d77e03999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.432988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7e962-d234-4d7d-aaf6-db0d77e03999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:21.445627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b79291b8b5d46769f1277bf815a3cce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:21.446747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b79291b8b5d46769f1277bf815a3cce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:21.450274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7e962-d234-4d7d-aaf6-db0d77e03999 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:21.488023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 839/1663] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:14:21.603207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b79291b8b5d46769f1277bf815a3cce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:21.603920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b91beea5-d481-4144-b70a-2289c3adeef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b79291b8b5d46769f1277bf815a3cce'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:21.609992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cbc4-3e8e-42c0-af62-09402e6e3cc6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.613925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cbc4-3e8e-42c0-af62-09402e6e3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.613925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2cbc4-3e8e-42c0-af62-09402e6e3cc6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.613925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 840/1664] 10.222.0.44 () {54 vars in 960 bytes} [Tue May 24 10:14:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:21.619758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06712-57c7-4ef1-9983-da583003627e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.619758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06712-57c7-4ef1-9983-da583003627e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.620010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06712-57c7-4ef1-9983-da583003627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.633100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:21.677273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 825/1665] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:20 2022] DELETE /identity/v3/users/1b79291b8b5d46769f1277bf815a3cce => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:21.679683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.680005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.680295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.709663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-59e06712-57c7-4ef1-9983-da583003627e None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:21.716712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59e06712-57c7-4ef1-9983-da583003627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.752929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:21.757269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.898846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 826/1667] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:21.899230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 841/1667] 10.222.0.44 () {58 vars in 1057 bytes} [Tue May 24 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:21.903719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:21.921583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e06712-57c7-4ef1-9983-da583003627e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:21.925075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59e06712-57c7-4ef1-9983-da583003627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.928887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52acda-5b69-47a6-911c-046d23520923 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:21.944775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:21.945447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:21.945814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:21.951304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:21.958156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:21.992071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:21.998053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:22.039329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 827/1668] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:22.077685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e06712-57c7-4ef1-9983-da583003627e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:22.088072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d32878-ceec-42a9-a4f3-8ccb8f99ef2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:22.088752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32878-ceec-42a9-a4f3-8ccb8f99ef2a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:22.089033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32878-ceec-42a9-a4f3-8ccb8f99ef2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:22.089309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d32878-ceec-42a9-a4f3-8ccb8f99ef2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:22.114119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d32878-ceec-42a9-a4f3-8ccb8f99ef2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:22.115611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d32878-ceec-42a9-a4f3-8ccb8f99ef2a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:22.145597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 842/1669] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:14:22.491183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:22.493296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:22.515283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737682d6-c624-45f0-b933-f47af64fb4d8 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:22.527074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:22.530077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:22.532185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:22.532740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] PATH_INFO: `/v3/projects/059ea34a3c8d43af9a62a65a687b2776` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:22.538880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=059ea34a3c8d43af9a62a65a687b2776)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:22.540387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: WARNING py.warnings [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 24 10:14:22.540387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: warnings.warn(msg) May 24 10:14:22.540387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: May 24 10:14:22.542278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:22.585671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96e4d-21af-484b-86f8-9b1265b28a26 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:22.586104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96e4d-21af-484b-86f8-9b1265b28a26 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:22.586496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96e4d-21af-484b-86f8-9b1265b28a26 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:22.588414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 843/1670] 10.222.0.44 () {54 vars in 912 bytes} [Tue May 24 10:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:22.607895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:22.607895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:22.607895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:22.645812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:22.652221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:22.693568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 844/1671] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:14:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:22.708152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:22.709615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:22.738594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bf3d1-b697-4992-90ae-fb4dde6782c3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:22.776024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '059ea34a3c8d43af9a62a65a687b2776', 'request_id': 'req-a379d048-b52e-42f9-8147-e83cbb11d85f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:22.802838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '059ea34a3c8d43af9a62a65a687b2776', 'request_id': 'req-a379d048-b52e-42f9-8147-e83cbb11d85f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:22.814303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '059ea34a3c8d43af9a62a65a687b2776', 'request_id': 'req-a379d048-b52e-42f9-8147-e83cbb11d85f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:22.865675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:22.866488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:22.866775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:22.867052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] PATH_INFO: `/v3/users/af64ffaa4eab4c03aaa0693178538994` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:22.868583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af64ffaa4eab4c03aaa0693178538994)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:22.870671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:22.951460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] The token cache is being invalidate because project 059ea34a3c8d43af9a62a65a687b2776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:22.955298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:22.957901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:22.964345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 828/1672] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:22 2022] DELETE /identity/v3/projects/059ea34a3c8d43af9a62a65a687b2776 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:22.970506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:22.970506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.031033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:23.115034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379d048-b52e-42f9-8147-e83cbb11d85f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:23.119318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:23.120235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:23.120703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:23.121230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:23.123550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.138551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:23.141063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:23.151202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 829/1673] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:23.152497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:23.154017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.156729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af64ffaa4eab4c03aaa0693178538994'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.172266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812db98-ef14-4e24-95cd-a7afc8c2125d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:23.177867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:23.179275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:23.179606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:23.179919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] PATH_INFO: `/v3/users/7338ceedd92c45d1bc492fd6822b2f16` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:23.183843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7338ceedd92c45d1bc492fd6822b2f16)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:23.185077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:23.204425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af64ffaa4eab4c03aaa0693178538994'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.207764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af64ffaa4eab4c03aaa0693178538994'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.208455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af64ffaa4eab4c03aaa0693178538994'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.296542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af64ffaa4eab4c03aaa0693178538994'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.321600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 845/1674] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:22 2022] DELETE /identity/v3/users/af64ffaa4eab4c03aaa0693178538994 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:23.326542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:23.329024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.459934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7338ceedd92c45d1bc492fd6822b2f16'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.488882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1264cb2-ebb6-4eb6-aaf2-d4e6e86d169d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:23.491340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7338ceedd92c45d1bc492fd6822b2f16'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.495164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7338ceedd92c45d1bc492fd6822b2f16'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.516545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:23.520108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:23.521482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:23.521789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:23.522077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] PATH_INFO: `/v3/projects/1305f42b19e14396935cdd8a4e8ba5f9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:23.524712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1305f42b19e14396935cdd8a4e8ba5f9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:23.534837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:23.615860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7338ceedd92c45d1bc492fd6822b2f16'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.617568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7e191ae1-cb7e-448a-98cc-8071127d4854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7338ceedd92c45d1bc492fd6822b2f16'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.671527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 830/1675] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:23 2022] DELETE /identity/v3/users/7338ceedd92c45d1bc492fd6822b2f16 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:23.673392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:23.675458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:23.676108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:23.744736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1305f42b19e14396935cdd8a4e8ba5f9', 'request_id': 'req-1f850da0-8d26-458f-8b73-224e7040d197'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.754453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:23.763765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.875184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1305f42b19e14396935cdd8a4e8ba5f9', 'request_id': 'req-1f850da0-8d26-458f-8b73-224e7040d197'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.885353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1305f42b19e14396935cdd8a4e8ba5f9', 'request_id': 'req-1f850da0-8d26-458f-8b73-224e7040d197'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.903033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 831/1676] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:23.909164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] The token cache is being invalidate because project 1305f42b19e14396935cdd8a4e8ba5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:23.911721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.913324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:23.920225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 846/1677] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:23 2022] DELETE /identity/v3/projects/1305f42b19e14396935cdd8a4e8ba5f9 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:23.921831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:23.923962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.932957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:23.934769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:23.943183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0676dd-ac0d-4bb2-b117-9bc3982f9d4b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:23.959945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:23.961034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:23.961460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:23.964727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] PATH_INFO: `/v3/users/f19283a76f0f47d28a4b007e1a6b8cfe` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:23.966302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19283a76f0f47d28a4b007e1a6b8cfe)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:23.975140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:24.096797 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850da0-8d26-458f-8b73-224e7040d197 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:24.114342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:24.115267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:24.116399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:24.117009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:24.121172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:24.156717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:24.158575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151364b1-1d91-497c-b05f-ba8d80b08c96 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:24.172220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:24.187279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 847/1678] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:14:24.226899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19283a76f0f47d28a4b007e1a6b8cfe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:24.251644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19283a76f0f47d28a4b007e1a6b8cfe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:24.252525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19283a76f0f47d28a4b007e1a6b8cfe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:24.369528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19283a76f0f47d28a4b007e1a6b8cfe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:24.370245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19283a76f0f47d28a4b007e1a6b8cfe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:24.414188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 832/1679] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:23 2022] DELETE /identity/v3/users/f19283a76f0f47d28a4b007e1a6b8cfe => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:24.497825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b677b-e28c-4757-854d-186234a88277 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:24.498071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b677b-e28c-4757-854d-186234a88277 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:24.500458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b677b-e28c-4757-854d-186234a88277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:24.546433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-291b677b-e28c-4757-854d-186234a88277 None None] MFA Rules not processed for user `04058cb7cf374eba92fb7ee796084e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:24.555578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-291b677b-e28c-4757-854d-186234a88277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:24.721774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 848/1680] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:24.740849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:25.156612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:25.158513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:25.369406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7135e6-2f3c-4ccb-89a2-ba678d712766 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:25.378297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:25.379368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:25.379768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:25.380202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] PATH_INFO: `/v3/projects/2e6b29c53aa8429ebe5bdd3d5d606fcc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:25.382943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e6b29c53aa8429ebe5bdd3d5d606fcc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:25.385068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:25.555393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e6b29c53aa8429ebe5bdd3d5d606fcc', 'request_id': 'req-e487b1a1-1f1f-476d-a0d9-211339d3e35a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:25.585739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e6b29c53aa8429ebe5bdd3d5d606fcc', 'request_id': 'req-e487b1a1-1f1f-476d-a0d9-211339d3e35a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:25.592261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b677b-e28c-4757-854d-186234a88277 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:25.593948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-291b677b-e28c-4757-854d-186234a88277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:25.602635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e6b29c53aa8429ebe5bdd3d5d606fcc', 'request_id': 'req-e487b1a1-1f1f-476d-a0d9-211339d3e35a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:25.633170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b677b-e28c-4757-854d-186234a88277 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:25.684236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] The token cache is being invalidate because project 2e6b29c53aa8429ebe5bdd3d5d606fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:25.684683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:25.688959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e487b1a1-1f1f-476d-a0d9-211339d3e35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:25.691045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 833/1681] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:25 2022] DELETE /identity/v3/projects/2e6b29c53aa8429ebe5bdd3d5d606fcc => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:25.695584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d12f-8112-4e1e-a77e-64c907ca7ffe None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:25.696023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d12f-8112-4e1e-a77e-64c907ca7ffe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:25.696442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208d12f-8112-4e1e-a77e-64c907ca7ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:25.762357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a208d12f-8112-4e1e-a77e-64c907ca7ffe None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:25.767284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a208d12f-8112-4e1e-a77e-64c907ca7ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:25.790681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:25.791854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:25.792897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:25.794074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] PATH_INFO: `/v3/projects/0957b700800c4b3687fffdf28c2b0064` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:25.796593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0957b700800c4b3687fffdf28c2b0064)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:25.799300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:25.947480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:25.952254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0957b700800c4b3687fffdf28c2b0064', 'request_id': 'req-7aaf7970-0e77-4c2a-9f39-e74febdac71c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:25.985702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 834/1682] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:25.993964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:25.993964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:25.994215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.027035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0957b700800c4b3687fffdf28c2b0064', 'request_id': 'req-7aaf7970-0e77-4c2a-9f39-e74febdac71c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.041266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0957b700800c4b3687fffdf28c2b0064', 'request_id': 'req-7aaf7970-0e77-4c2a-9f39-e74febdac71c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.055312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:26.056664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:26.067200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] The token cache is being invalidate because project 0957b700800c4b3687fffdf28c2b0064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:26.067494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.071199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aaf7970-0e77-4c2a-9f39-e74febdac71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.079670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 849/1683] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:25 2022] DELETE /identity/v3/projects/0957b700800c4b3687fffdf28c2b0064 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:26.087533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6e8b-c8ed-4aa1-bf17-faa6bbf29c14 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.087832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6e8b-c8ed-4aa1-bf17-faa6bbf29c14 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.088108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6e8b-c8ed-4aa1-bf17-faa6bbf29c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.145608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b6ea6e8b-c8ed-4aa1-bf17-faa6bbf29c14 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:26.146835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6ea6e8b-c8ed-4aa1-bf17-faa6bbf29c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:26.254245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 835/1684] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:26.258041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.284746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b78c6-9b2f-4fc0-8b1e-b8bd535e968b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:26.292815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:26.294259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.296356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.296784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.298271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:26.300129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:26.301927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:26.306905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 850/1685] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:26.315253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.315748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.316185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.336265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 836/1686] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:26.337450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.355910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:26.359123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f1e7b-f38d-4706-8d88-b7b845450489 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:26.363116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:26.380125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:26.380697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.380986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.381266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.381982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:26.390427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:26.392407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 851/1687] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:26.395170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.399222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:26.421117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539583a-a034-4551-a38c-1cdb61cbc527 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:26.430273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:26.430983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.431310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.431676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.432504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:26.432815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:26.434461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:26.480403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 852/1688] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:26.480403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.487951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:26.511989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 837/1689] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:26 2022] POST /identity/v3/projects => generated 355 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:26.511989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.522461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914f84c-653f-4a11-a35c-836c0e8c6f99 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:26.652625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28d473-1042-4b64-956c-b4aed359f163 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:26.661986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:26.669076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.669076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.669076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.669076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:26.669076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:26.679870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:26.681485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:26.681993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:26.682405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] PATH_INFO: `/v3/projects/117092c933ec4467ac0ad7f900e675fd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:26.683906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117092c933ec4467ac0ad7f900e675fd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:26.686587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:26.798244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 838/1690] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:26 2022] POST /identity/v3/projects => generated 369 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:26.802433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.817907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117092c933ec4467ac0ad7f900e675fd', 'request_id': 'req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.917798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117092c933ec4467ac0ad7f900e675fd', 'request_id': 'req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.927326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117092c933ec4467ac0ad7f900e675fd', 'request_id': 'req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.958154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] The token cache is being invalidate because project 117092c933ec4467ac0ad7f900e675fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:26.958604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.959451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:26.968567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 853/1691] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:26 2022] DELETE /identity/v3/projects/117092c933ec4467ac0ad7f900e675fd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:26.968683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:26.976021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:27.026491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7285e-1949-47fa-ab8b-a53914104ade admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.078523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5eb2b-3f6d-4973-ae0a-b177dbffc695 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.086673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0f082-7683-4a3d-a631-db1df6ab289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.087626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0f082-7683-4a3d-a631-db1df6ab289d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.088251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0f082-7683-4a3d-a631-db1df6ab289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.088680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0f082-7683-4a3d-a631-db1df6ab289d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.090722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0f082-7683-4a3d-a631-db1df6ab289d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.093490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd0f082-7683-4a3d-a631-db1df6ab289d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.240511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:27.250276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 854/1692] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:26 2022] POST /identity/v3/users => generated 285 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:27.254045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.254524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.254938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.258575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.260164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.260886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.261922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.263149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.273531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.310810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:27.314630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:27.342540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 855/1693] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:27.344158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.390352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cd4ce-f824-43cb-aa95-6719b00da5e5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.396910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75352ff2-ea51-4a1e-9d7f-9404e30cd71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.397956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352ff2-ea51-4a1e-9d7f-9404e30cd71e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.398748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352ff2-ea51-4a1e-9d7f-9404e30cd71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.399388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75352ff2-ea51-4a1e-9d7f-9404e30cd71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.400445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75352ff2-ea51-4a1e-9d7f-9404e30cd71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.404051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75352ff2-ea51-4a1e-9d7f-9404e30cd71e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.421572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 856/1694] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:27.423590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.424125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.424788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.467060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 839/1695] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:26 2022] POST /identity/v3/users => generated 278 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:27.470529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.504736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:27.506235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:27.524365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6319-4dae-4778-93ad-df838af3f8ba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.541523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 857/1696] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:27.542901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.544623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:27.546168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.554057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.555329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.557417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.559503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.567757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.583663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8d53-1b6f-45d5-98ae-3cfbcdff3a4b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.589854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.590742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.591606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.592219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.594681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.597005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.610215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 840/1697] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:27.616311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.616726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 858/1698] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:27.618091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.654369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c01c2-c00d-459b-8154-82cc8de177c9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.665661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828c23-997b-4c30-8676-5fdd06b4eef9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.677713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.690372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.690372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.690372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.690372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:27.690372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.690372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.708599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.713664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.714186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.718536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] PATH_INFO: `/v3/projects/fbb2a4d6c4ab4767831cbf4617055879/users/152177c0ee1a40018b728cdb5e53e4c2/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.748232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 841/1699] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:27.750114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.759943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb2a4d6c4ab4767831cbf4617055879, user_id=152177c0ee1a40018b728cdb5e53e4c2, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.766799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.774912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db395-4207-49b9-9443-58fb789c8eb5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.788490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.791889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.792352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.796441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.796441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.796441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.808991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 842/1700] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:27.815871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.829647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ea5b5-286f-435b-999e-4a90f6bcae16 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:27.835261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c594aa8-85bc-448d-8481-4004f43ad1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:27.836142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594aa8-85bc-448d-8481-4004f43ad1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.836526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594aa8-85bc-448d-8481-4004f43ad1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.836903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594aa8-85bc-448d-8481-4004f43ad1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:27.838470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c594aa8-85bc-448d-8481-4004f43ad1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:27.840910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c594aa8-85bc-448d-8481-4004f43ad1c7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:27.894304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 859/1701] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:27 2022] PUT /identity/v3/projects/fbb2a4d6c4ab4767831cbf4617055879/users/152177c0ee1a40018b728cdb5e53e4c2/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:27.895600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:27.954526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 843/1702] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:27 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:27.958658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:27.959051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:27.961626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.052789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] MFA Rules not processed for user `152177c0ee1a40018b728cdb5e53e4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:28.055423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:28.123247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2c84-f759-49c1-bc56-715e7805821c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:28.230312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 844/1703] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:28.231636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:28.253590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:28.254507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:28.257435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:28.260179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] PATH_INFO: `/v3/projects/a85c56f2a3b848c9bb67f7e0972e0668/users/3a393beddb714826b4d3315aacf81ebd/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.307953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85c56f2a3b848c9bb67f7e0972e0668, user_id=3a393beddb714826b4d3315aacf81ebd, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:28.312628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c3863-7f7b-4297-b5b8-c128ba3e17ad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:28.313119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:28.319917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:28.320910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:28.321430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:28.322117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.323833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:28.326203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:28.483656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:28.508810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 860/1704] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:27 2022] PUT /identity/v3/projects/a85c56f2a3b848c9bb67f7e0972e0668/users/3a393beddb714826b4d3315aacf81ebd/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:28.508810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:28.508973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 845/1705] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:28 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:28.510063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:28.530748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e8623-a2e3-4220-bb06-5948e33e979f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:28.714903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dfc94-874b-471f-945e-5b06435e3dc3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:28.737863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99204a9-d80b-43e5-92e8-785524e4a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:28.740873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99204a9-d80b-43e5-92e8-785524e4a170 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:28.754499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99204a9-d80b-43e5-92e8-785524e4a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:28.755024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99204a9-d80b-43e5-92e8-785524e4a170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.756081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99204a9-d80b-43e5-92e8-785524e4a170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:28.758193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99204a9-d80b-43e5-92e8-785524e4a170 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:28.795711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186a67-5b1f-440d-a397-5dfa329e2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:28.796960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186a67-5b1f-440d-a397-5dfa329e2c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:28.797419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186a67-5b1f-440d-a397-5dfa329e2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:28.797834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186a67-5b1f-440d-a397-5dfa329e2c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.798765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38186a67-5b1f-440d-a397-5dfa329e2c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:28.801099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38186a67-5b1f-440d-a397-5dfa329e2c1a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:28.833135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 846/1706] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:28.833135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:28.833456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:28.833740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.899220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 861/1707] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:28 2022] POST /identity/v3/projects => generated 367 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:28.902391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:28.908845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:28.910078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] MFA Rules not processed for user `3a393beddb714826b4d3315aacf81ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:28.911686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:28.913309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:28.954769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:28.956620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:29.082425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 847/1708] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:29.087353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.141384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 862/1709] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:29.145377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.244205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508bb9b-b620-4403-a989-3f0ab4ee2b4e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:29.258408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:29.260128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:29.260574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:29.265844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:29.265844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:29.268492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:29.301737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 848/1710] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:29.301737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.322548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b315-c63c-4ce5-9ad8-3360a81f8ceb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:29.326420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a6f64-0e1b-4396-a0a7-ab41fee638e3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:29.339353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:29.339353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:29.339353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:29.339353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:29.339716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:29.342554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:29.343259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:29.343548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:29.343851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:29.344618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:29.346594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:29.356494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:29.388473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:29.458357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 863/1711] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:29 2022] POST /identity/v3/users => generated 290 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:29.460265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.460560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 849/1712] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:29 2022] POST /identity/v3/projects => generated 357 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:29.465074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.477511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefeaf2-cd42-4eeb-af93-577284777fd1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:29.644257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:29.645456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:29.645947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:29.646567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] PATH_INFO: `/v3/projects/06a80bd3135e4161a4fcfd2e73e6f838/users/2c94b835e06445b0ab849c53b5cb67cf/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:29.697910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a80bd3135e4161a4fcfd2e73e6f838, user_id=2c94b835e06445b0ab849c53b5cb67cf, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:29.708588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:29.731504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335bb5c-b7c2-43df-a92e-0c9ee865bae6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:29.745792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:29.746498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:29.746788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:29.747069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:29.748618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:29.750438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:29.780975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 850/1713] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:29.792230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.811975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 864/1714] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:29 2022] PUT /identity/v3/projects/06a80bd3135e4161a4fcfd2e73e6f838/users/2c94b835e06445b0ab849c53b5cb67cf/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:29.820375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:29.822579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:29.834012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:29.853616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ff752-1a3e-4cde-88c7-34dce2f16375 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:30.010384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345194-3fe8-4b9a-a9db-8504617379dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:30.031965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428479-5978-478b-acea-c4f4617cbdda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:30.032836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428479-5978-478b-acea-c4f4617cbdda service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.034479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428479-5978-478b-acea-c4f4617cbdda service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.034479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428479-5978-478b-acea-c4f4617cbdda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.034693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:30.036192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.037130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.038455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.039552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:30.043123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:30.180522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 851/1715] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:29 2022] POST /identity/v3/users => generated 285 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:30.180522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:30.203507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178367d-8c3f-46e9-bcce-9f4faee48104 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:30.222104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:30.223010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.223294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.224104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] PATH_INFO: `/v3/projects/88bdc632adfd40beb3e12160c0150e91/users/e8ac8cf55fa345c7b236fe486359d195/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.261436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428479-5978-478b-acea-c4f4617cbdda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:30.262845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428479-5978-478b-acea-c4f4617cbdda service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:30.305070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 865/1716] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:14:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:14:30.319234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bdc632adfd40beb3e12160c0150e91, user_id=e8ac8cf55fa345c7b236fe486359d195, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:30.334108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.335745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:30.336547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.336826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.435393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 852/1717] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:30 2022] PUT /identity/v3/projects/88bdc632adfd40beb3e12160c0150e91/users/e8ac8cf55fa345c7b236fe486359d195/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:30.436533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:30.523627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] MFA Rules not processed for user `2c94b835e06445b0ab849c53b5cb67cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:30.524907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:30.665036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665e9ee-ec39-43b2-aff8-13fe256ae09e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:30.706087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:30.706801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.709274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.722744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.723718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:30.725443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:30.812440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:30.822298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 853/1718] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:30.822298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:30.829290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:30.857684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 866/1719] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:30.859292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:30.896146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338edc0-d3e4-45a7-96a8-5b531d18a2f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:30.897407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8085d-5e83-4e04-8a9a-b9704d5ff984 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:30.913977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:30.914908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.915203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.915466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] PATH_INFO: `/v3/projects/bf7775d2761741ff90481b2e44eef54b/users/1d16b5bf77414882a6295d3b9185ad9a/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.928071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:30.930255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:30.931995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:30.933884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:30.934868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:30.943621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:30.988986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7775d2761741ff90481b2e44eef54b, user_id=1d16b5bf77414882a6295d3b9185ad9a, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:30.991587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:31.004860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 854/1720] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:31.007100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:31.034212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e86c5-6e2b-417e-9e9f-92829fd7eb00 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:31.056115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:31.059192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:31.059443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:31.061921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:31.062684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:31.070376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:31.100907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 867/1721] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:30 2022] PUT /identity/v3/projects/bf7775d2761741ff90481b2e44eef54b/users/1d16b5bf77414882a6295d3b9185ad9a/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:31.102078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:31.215105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 855/1722] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:31.215105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:31.266357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbc25-8f7d-4b2d-879f-6b86e436d3b8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:31.388524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd623c-935f-4379-a597-16aa008d88a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:31.411024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:31.411678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:31.411995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:31.412276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:31.413117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:31.415105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:31.427218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:31.431833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:31.435130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:31.435130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:31.435130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] PATH_INFO: `/v3/projects/88bdc632adfd40beb3e12160c0150e91/users/e8ac8cf55fa345c7b236fe486359d195/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:31.442480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bdc632adfd40beb3e12160c0150e91, user_id=e8ac8cf55fa345c7b236fe486359d195, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:31.447423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 856/1723] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:31.448434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:31.451118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:31.469254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03cf36-f64e-4eb6-a0ea-6d71b66c26f7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:31.483997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 868/1724] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:31 2022] PUT /identity/v3/projects/88bdc632adfd40beb3e12160c0150e91/users/e8ac8cf55fa345c7b236fe486359d195/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:31.486819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:31.708827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fb741-bdf2-44d5-898c-755d54a0318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:31.708827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fb741-bdf2-44d5-898c-755d54a0318a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:31.708827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fb741-bdf2-44d5-898c-755d54a0318a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:31.708827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fb741-bdf2-44d5-898c-755d54a0318a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:31.709176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fb741-bdf2-44d5-898c-755d54a0318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:31.709176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fb741-bdf2-44d5-898c-755d54a0318a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:31.757211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fea71-1abf-4ceb-a786-5efd2d7f8a1d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:31.907990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2279a1c-49b0-4669-8bfc-15f5da0ac302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:31.907990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279a1c-49b0-4669-8bfc-15f5da0ac302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:31.907990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279a1c-49b0-4669-8bfc-15f5da0ac302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:31.907990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2279a1c-49b0-4669-8bfc-15f5da0ac302 admin admin] PATH_INFO: `/v3/projects/bf7775d2761741ff90481b2e44eef54b/users/1d16b5bf77414882a6295d3b9185ad9a/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:31.924734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2279a1c-49b0-4669-8bfc-15f5da0ac302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7775d2761741ff90481b2e44eef54b, user_id=1d16b5bf77414882a6295d3b9185ad9a, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:31.924734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2279a1c-49b0-4669-8bfc-15f5da0ac302 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:31.924734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 869/1725] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:31 2022] PUT /identity/v3/projects/bf7775d2761741ff90481b2e44eef54b/users/1d16b5bf77414882a6295d3b9185ad9a/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:31.924734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1750d9-ddc0-4f5f-9658-9ad331dd8854 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:31.924734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1750d9-ddc0-4f5f-9658-9ad331dd8854 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:31.924734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1750d9-ddc0-4f5f-9658-9ad331dd8854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:31.958982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1e1750d9-ddc0-4f5f-9658-9ad331dd8854 None None] MFA Rules not processed for user `e8ac8cf55fa345c7b236fe486359d195`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:31.960428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e1750d9-ddc0-4f5f-9658-9ad331dd8854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:32.147617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:32.149511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 857/1726] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:31 2022] POST /identity/v3/users => generated 293 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:32.173532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:32.173532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:32.173532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:32.184564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 870/1727] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:32.187867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:32.188194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:32.195896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:32.256202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] MFA Rules not processed for user `06e9e172155548289ca938421d4e32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:32.259516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:32.313087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] MFA Rules not processed for user `1d16b5bf77414882a6295d3b9185ad9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:32.323761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:32.425614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 858/1728] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:32.426945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:32.562423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:32.573979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 871/1729] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:32.575842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:32.585045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:32.638380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e869966-b16c-4f57-a4b0-107ff9b2922b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:32.656472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:32.658667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:32.661749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:32.661749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:32.662536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:32.664808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:32.695358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:32.706793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 859/1730] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:32.708533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:32.713457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:32.734444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eee33-cfa9-4ed2-9945-69bfdb322ba8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:32.743949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:32.745086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:32.745478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:32.745860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] PATH_INFO: `/v3/users/e9ca464e9176482f9567d9bf70559844` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:32.747576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ca464e9176482f9567d9bf70559844)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:32.754451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:32.804254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155b650-a440-411e-8e29-c3499afbe119 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:32.818462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:32.821392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:32.824305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:32.827667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:32.879578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:32.886599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:32.916789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 872/1731] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:32.919528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:32.922915 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:33.065180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ca464e9176482f9567d9bf70559844'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:33.100614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:33.103404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ca464e9176482f9567d9bf70559844'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:33.104367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ca464e9176482f9567d9bf70559844'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:33.118138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:33.161400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00229a1-b2ee-4171-b082-264b23b2046b service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:33.187361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccae483-0675-4dc2-810d-ce2effc7e5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:33.189233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae483-0675-4dc2-810d-ce2effc7e5bf service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:33.189606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae483-0675-4dc2-810d-ce2effc7e5bf service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:33.190009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccae483-0675-4dc2-810d-ce2effc7e5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:33.197745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ca464e9176482f9567d9bf70559844'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:33.198485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ca464e9176482f9567d9bf70559844'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:33.222704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccae483-0675-4dc2-810d-ce2effc7e5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:33.224504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccae483-0675-4dc2-810d-ce2effc7e5bf service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:33.225128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 860/1732] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:32 2022] DELETE /identity/v3/users/e9ca464e9176482f9567d9bf70559844 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:33.226305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:33.229876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:33.257744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 873/1733] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:33.259287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:33.259627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:33.259937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:33.339833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] MFA Rules not processed for user `eec86bb8790745aaaa45b6d9e4d94ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:33.343347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:33.423493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e5f00-cff8-4dae-b5ea-9edf7a6ee624 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:33.451069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:33.456367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:33.456887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:33.457180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:33.461555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:33.623873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 874/1734] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:33.624644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:33.636587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:33.696860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:33.709944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:33.718497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bda75-a36f-49e0-b259-6ded7e545cda service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:33.765652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 861/1735] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:33.773673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa508e3-be4c-4635-8d53-7acfa7a930de None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:33.774305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa508e3-be4c-4635-8d53-7acfa7a930de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:33.774589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa508e3-be4c-4635-8d53-7acfa7a930de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:33.840369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-baa508e3-be4c-4635-8d53-7acfa7a930de None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:33.845684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-baa508e3-be4c-4635-8d53-7acfa7a930de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:33.876241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ba8c0-6a1e-4b92-857d-0e49cb3b15bd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:33.889827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:33.890319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:33.890603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:33.890873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] PATH_INFO: `/v3/projects/26588f0f471845c0b4d333fbf084e242/users/b601b9dc03354237bb5ceff285b572a4/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:33.965271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26588f0f471845c0b4d333fbf084e242, user_id=b601b9dc03354237bb5ceff285b572a4, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:33.972420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:34.016292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 862/1736] 10.222.0.41 () {58 vars in 1015 bytes} [Tue May 24 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:34.018402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.018556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.019038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.055462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:34.055462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:34.087769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 875/1737] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:33 2022] PUT /identity/v3/projects/26588f0f471845c0b4d333fbf084e242/users/b601b9dc03354237bb5ceff285b572a4/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:34.089140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.097187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:34.112807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 863/1738] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:34.112807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.112807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:34.142195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad941fe1-cb47-4b30-8535-02871f1f39a4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:34.208173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:34.259815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:34.259815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.259815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.259815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.275174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:34.282834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:34.333125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 864/1739] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:34.334235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.368750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027963db-e864-48d6-b70e-e4c779db0381 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:34.400349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:34.401022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.412082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.412082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.466757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:34.469770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:34.491694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 865/1740] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:34.492650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.497965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae880d45-8051-4bcf-8ac6-5609375bc23d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:34.507346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:34.536024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:34.536721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.536894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45cb4e-6424-4a71-9745-3520eafb671d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:34.537001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.537284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.551316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:34.552087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.552422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.552755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.569271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:34.571024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:34.597341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 866/1741] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:34.598409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.853689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7002c-2a85-4a85-bc3e-566a670c2ff5 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:34.869878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:34.871275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:34.872244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.872540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.872832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.874112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:34.875768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:34.879420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:34.897218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 867/1742] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:34.897986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.928964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876fd95-cbd5-4b73-bca7-10c824daa39b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:34.934581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 876/1743] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:34.937381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:34.954662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:34.954662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:34.954662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:34.954662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:34.992509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:34.994282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:35.041097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 868/1744] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:35.041990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:35.099210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5408730-6624-49b4-9575-7f4a1f8c48ab service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:35.127693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1d26-078c-4991-ac57-83e36b379106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:35.128615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1d26-078c-4991-ac57-83e36b379106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:35.128904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1d26-078c-4991-ac57-83e36b379106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:35.129188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1d26-078c-4991-ac57-83e36b379106 admin admin] PATH_INFO: `/v3/projects/26588f0f471845c0b4d333fbf084e242/users/b601b9dc03354237bb5ceff285b572a4/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:35.138110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1d26-078c-4991-ac57-83e36b379106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26588f0f471845c0b4d333fbf084e242, user_id=b601b9dc03354237bb5ceff285b572a4, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:35.140962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1d26-078c-4991-ac57-83e36b379106 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:35.193624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:35.203025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 869/1745] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:35 2022] PUT /identity/v3/projects/26588f0f471845c0b4d333fbf084e242/users/b601b9dc03354237bb5ceff285b572a4/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:35.213721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:35.214560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:35.214560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:35.276321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1957a9a-29cc-4f24-9d82-cb112f366267 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:35.309312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] MFA Rules not processed for user `b601b9dc03354237bb5ceff285b572a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:35.310583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:35.553322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:35.555899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:35.557279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:35.557573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:35.561241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:35.708496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 870/1746] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:35.752762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:35.754291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:35.770734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:35.785952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf41b6-f859-4884-b90f-aa19ce3512cf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:35.793271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:35.797022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:35.797348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:35.797624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:35.811557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:35.811557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:35.830406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:35.832224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:35.862227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 877/1747] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 918 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:35.880542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 871/1748] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:36.400353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:36.417109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316049c-1543-4e20-bc9a-f233bb3d20e3 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:36.445123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:36.446090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:36.446090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:36.458460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:36.471365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:36.658331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:36.662445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69cf2a-ca13-4916-b863-ab6ec6ec3b97 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:36.686728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 878/1749] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:38.682335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:38.684038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:38.917065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949a9df-1d36-484f-8eaf-1b2bfad67a9d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:38.931867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:38.936535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:38.937197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:38.939851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] PATH_INFO: `/v3/projects/8a95b870e08f455ca508bff5b565a8ef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:38.945222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a95b870e08f455ca508bff5b565a8ef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:38.947846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:39.135643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c32e-3aba-4159-9da7-e8726f35fe33 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:39.136462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c32e-3aba-4159-9da7-e8726f35fe33 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:39.137061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3c32e-3aba-4159-9da7-e8726f35fe33 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:39.140143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 879/1750] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:14:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:39.143453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a95b870e08f455ca508bff5b565a8ef', 'request_id': 'req-766e39c9-63f0-4987-a713-60abed5d6a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:39.154060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a95b870e08f455ca508bff5b565a8ef', 'request_id': 'req-766e39c9-63f0-4987-a713-60abed5d6a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:39.163910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a95b870e08f455ca508bff5b565a8ef', 'request_id': 'req-766e39c9-63f0-4987-a713-60abed5d6a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:39.233427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:39.233882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:39.234258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:39.281223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:39.283187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:39.305547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] The token cache is being invalidate because project 8a95b870e08f455ca508bff5b565a8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:39.305868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:39.309945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:39.316576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 872/1751] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:38 2022] DELETE /identity/v3/projects/8a95b870e08f455ca508bff5b565a8ef => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:39.343441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:39.343441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:39.466225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:39.589557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 880/1752] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:14:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:39.657602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e39c9-63f0-4987-a713-60abed5d6a77 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:39.691815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:39.693274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:39.693274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:39.693274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] PATH_INFO: `/v3/users/6639020ad2c5467a9752ae437a57cde3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:39.704680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6639020ad2c5467a9752ae437a57cde3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:39.717860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:39.839013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:40.064738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6639020ad2c5467a9752ae437a57cde3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:40.098080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6639020ad2c5467a9752ae437a57cde3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:40.098842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6639020ad2c5467a9752ae437a57cde3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:40.231760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6639020ad2c5467a9752ae437a57cde3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:40.233777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6639020ad2c5467a9752ae437a57cde3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:40.269989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 873/1753] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:39 2022] DELETE /identity/v3/users/6639020ad2c5467a9752ae437a57cde3 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:40.662217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:40.669590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:40.702819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843d310-3722-4b69-ab35-6f968d2d468a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:40.918077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:40.920121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:40.921273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:40.922990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:40.928065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:40.974763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:40.977027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d2b54-e720-4f2f-b10f-dd371f080f8e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:41.007895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 881/1754] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:41.055909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:41.057576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:41.215854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b2b7-7c70-4cb5-aa1b-e5385b62e582 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:41.216528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b2b7-7c70-4cb5-aa1b-e5385b62e582 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:41.217547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86b2b7-7c70-4cb5-aa1b-e5385b62e582 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:41.235708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 882/1755] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:14:41 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:41.322675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92802ba-2bc9-4123-bc26-d7b616e74ea0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:41.343012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:41.344483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:41.345754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:41.347890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] PATH_INFO: `/v3/users/152177c0ee1a40018b728cdb5e53e4c2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:41.352200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152177c0ee1a40018b728cdb5e53e4c2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:41.369056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:41.370141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:41.370909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:41.371389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:41.419588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:41.423157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:41.467990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 883/1756] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:14:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:41.511767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:41.517926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:41.544338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbfa64-d417-41df-a0fa-9c729f94065b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:41.552478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcaa40-1dec-45b9-ab56-bfd6f6d3964a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:41.553517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcaa40-1dec-45b9-ab56-bfd6f6d3964a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:41.554067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcaa40-1dec-45b9-ab56-bfd6f6d3964a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:41.555290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcaa40-1dec-45b9-ab56-bfd6f6d3964a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:41.570127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcaa40-1dec-45b9-ab56-bfd6f6d3964a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:41.572515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcaa40-1dec-45b9-ab56-bfd6f6d3964a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:41.603048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 884/1757] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:14:41.663669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152177c0ee1a40018b728cdb5e53e4c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:41.727299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152177c0ee1a40018b728cdb5e53e4c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:41.728722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152177c0ee1a40018b728cdb5e53e4c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:41.860290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152177c0ee1a40018b728cdb5e53e4c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:41.861199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152177c0ee1a40018b728cdb5e53e4c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:41.882082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 874/1758] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:41 2022] DELETE /identity/v3/users/152177c0ee1a40018b728cdb5e53e4c2 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:41.891141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:41.891726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:41.891726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:41.934409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:41.936949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:42.151316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 885/1759] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:42.181672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:42.183252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:42.257005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:42.278327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991ade2-c3e7-41e9-8889-e9a0c07f64d2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:42.287106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6448f91-9ebb-43d2-a531-852559fb6978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:42.288060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6448f91-9ebb-43d2-a531-852559fb6978 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:42.288546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6448f91-9ebb-43d2-a531-852559fb6978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:42.288995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6448f91-9ebb-43d2-a531-852559fb6978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:42.308709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6448f91-9ebb-43d2-a531-852559fb6978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:42.310761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6448f91-9ebb-43d2-a531-852559fb6978 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:42.340661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 875/1760] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:42.435397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:42.437931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:42.461019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31be0e-ccc6-455a-84b7-d9996dc4cc31 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:42.483551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:42.484657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:42.485010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:42.486481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] PATH_INFO: `/v3/projects/09429a2748a84f2aa1188fba0525cc84` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:42.487479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=09429a2748a84f2aa1188fba0525cc84)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:42.490442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:42.648830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:42.663268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09429a2748a84f2aa1188fba0525cc84', 'request_id': 'req-efceb27b-6e5c-428e-99fa-99ebb866e6ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:42.785425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09429a2748a84f2aa1188fba0525cc84', 'request_id': 'req-efceb27b-6e5c-428e-99fa-99ebb866e6ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:42.793976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09429a2748a84f2aa1188fba0525cc84', 'request_id': 'req-efceb27b-6e5c-428e-99fa-99ebb866e6ed'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:42.816470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] The token cache is being invalidate because project 09429a2748a84f2aa1188fba0525cc84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:42.816757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:42.817546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-efceb27b-6e5c-428e-99fa-99ebb866e6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:42.823212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 886/1761] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:42 2022] DELETE /identity/v3/projects/09429a2748a84f2aa1188fba0525cc84 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:42.825145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:42.825436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:42.825716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:42.846321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:42.852761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:42.912821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 876/1762] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:42.920937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:42.921848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:42.922133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:42.941520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:42.942744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:42.950873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 887/1763] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:42.956438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:42.967580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938f3c7-f04d-40e5-a540-f019237ef4c9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:42.972548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:42.973520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:42.973520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:42.973763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:42.974501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:42.974807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:42.976453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:42.992010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 877/1764] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:42.993620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:42.994091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:42.996286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.012714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5bf3c-a446-43b9-b30c-5810a6f5416b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.014301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbd25a-182b-4e9a-aabb-46b21cbc226a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.024366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.024366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.024366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.024366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] PATH_INFO: `/v3/projects/fbb2a4d6c4ab4767831cbf4617055879` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.024979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.025269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.025411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.025899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.026604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.028591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.028721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb2a4d6c4ab4767831cbf4617055879)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.031612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.170339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 878/1765] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:42 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:43.175036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:43.209961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb2a4d6c4ab4767831cbf4617055879', 'request_id': 'req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.239901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239cf7-f171-46db-913c-231dd390f670 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.295447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.296154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.296444 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.296741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.297425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.299433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.299945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb2a4d6c4ab4767831cbf4617055879', 'request_id': 'req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.307412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb2a4d6c4ab4767831cbf4617055879', 'request_id': 'req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.320166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] The token cache is being invalidate because project fbb2a4d6c4ab4767831cbf4617055879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:43.320463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.321186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.322751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 888/1766] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:42 2022] DELETE /identity/v3/projects/fbb2a4d6c4ab4767831cbf4617055879 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:43.326708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:43.328340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.343378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea0c4-cc65-41a9-b347-b0cb7cb28007 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.348124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.349127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.349418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.349700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] PATH_INFO: `/v3/users/e8ac8cf55fa345c7b236fe486359d195` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.351057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ac8cf55fa345c7b236fe486359d195)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.353169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.391910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 879/1767] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:43 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:43.399334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:43.399334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.409863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa992a-931c-4605-aaa2-4174bc18de27 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.414725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.415389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.415676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.415985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.416983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.419577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.434288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 880/1768] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:14:43.435210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:43.447419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe2b4e-3543-4ac0-885c-a4a0a9056990 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.452328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3defe4-3f4c-4ca8-838b-c981459ecd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.455248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3defe4-3f4c-4ca8-838b-c981459ecd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.455535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3defe4-3f4c-4ca8-838b-c981459ecd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.456088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3defe4-3f4c-4ca8-838b-c981459ecd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.456828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3defe4-3f4c-4ca8-838b-c981459ecd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.458652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3defe4-3f4c-4ca8-838b-c981459ecd22 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.474187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 881/1769] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:43.474187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.474187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.474187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.490295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] MFA Rules not processed for user `eec86bb8790745aaaa45b6d9e4d94ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:43.491500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.547510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ac8cf55fa345c7b236fe486359d195'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.557342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 882/1770] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:43.558210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:43.562260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ac8cf55fa345c7b236fe486359d195'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.563368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ac8cf55fa345c7b236fe486359d195'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.564108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ac8cf55fa345c7b236fe486359d195'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.587989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ecf05-a2d9-4481-8c47-0c62a0d48071 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.593323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.594374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.594664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.594940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] PATH_INFO: `/v3/projects/c2217631eb7c42398a7ae6eab8e9621f/users/db63be051a7b44d681dbcef20f7bbfa9/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.614019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2217631eb7c42398a7ae6eab8e9621f, user_id=db63be051a7b44d681dbcef20f7bbfa9, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.617096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.625493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-40d397fc-9cdb-422b-933d-8839f262d49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ac8cf55fa345c7b236fe486359d195'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:43.644269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 889/1771] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:43 2022] DELETE /identity/v3/users/e8ac8cf55fa345c7b236fe486359d195 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:43.683350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 883/1772] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:43 2022] PUT /identity/v3/projects/c2217631eb7c42398a7ae6eab8e9621f/users/db63be051a7b44d681dbcef20f7bbfa9/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:43.695671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ecdf2-fdd4-472e-b6f3-b91fca8bb2e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.696071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ecdf2-fdd4-472e-b6f3-b91fca8bb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.696452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ecdf2-fdd4-472e-b6f3-b91fca8bb2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.727072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fe9ecdf2-fdd4-472e-b6f3-b91fca8bb2e4 None None] MFA Rules not processed for user `db63be051a7b44d681dbcef20f7bbfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:43.728432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe9ecdf2-fdd4-472e-b6f3-b91fca8bb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.812502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 890/1773] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:43.813804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:43.815905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.827615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.827966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.828209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.851379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] MFA Rules not processed for user `06e9e172155548289ca938421d4e32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:43.854907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:43.930966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffd349-5e3c-4adc-a86d-52338dd10204 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:43.936998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:43.940021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:43.940021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:43.940021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:43.940021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:43.942380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:43.949488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 891/1774] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:44.054482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 884/1775] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:43 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:44.054666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.060827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb180-b450-43d8-a681-2b1b58c57788 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.124381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.125059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.125344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.125621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.126319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.128283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.148272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.150209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.152118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:44.165474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f53fa-3e5c-4fc3-96d6-e603a3da9fb2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.171966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.172890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.178039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.178039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] PATH_INFO: `/v3/projects/88bdc632adfd40beb3e12160c0150e91` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.178039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bdc632adfd40beb3e12160c0150e91)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.178039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.206031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 892/1776] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:44 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:44.211749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.222700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff6483-f170-4326-9276-dc3f01ca5bd1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.226377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:44.228186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.229062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.233246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.233246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.233246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.233246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.249702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 893/1777] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:44.254173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.264963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f47d7-bd52-465c-ba89-d542969590a6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.270417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.271300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.271588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.272516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] PATH_INFO: `/v3/projects/de00ae32408f431a9b063c5d2aa724e5/users/b276e6a75293440e8b6a6ece4c7bb144/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.296178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de00ae32408f431a9b063c5d2aa724e5, user_id=b276e6a75293440e8b6a6ece4c7bb144, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.297263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bdc632adfd40beb3e12160c0150e91', 'request_id': 'req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:44.299473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.315058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bdc632adfd40beb3e12160c0150e91', 'request_id': 'req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:44.322373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bdc632adfd40beb3e12160c0150e91', 'request_id': 'req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:44.402921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 894/1778] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:44 2022] PUT /identity/v3/projects/de00ae32408f431a9b063c5d2aa724e5/users/b276e6a75293440e8b6a6ece4c7bb144/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:44.407512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.432016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] The token cache is being invalidate because project 88bdc632adfd40beb3e12160c0150e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:44.433811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:44.433811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12501ee5-e8d3-4f72-a211-22a8fd7ac5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:44.436258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 885/1779] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:44 2022] DELETE /identity/v3/projects/88bdc632adfd40beb3e12160c0150e91 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:44.441521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca7d5-9f91-4791-b53e-40f464da158e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.442032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca7d5-9f91-4791-b53e-40f464da158e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.442531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca7d5-9f91-4791-b53e-40f464da158e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.464550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-255ca7d5-9f91-4791-b53e-40f464da158e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:44.466034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-255ca7d5-9f91-4791-b53e-40f464da158e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.499231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003205-1654-4e5f-9993-f71ebdea894d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.504352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.505225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.505644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.505926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.506655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.508304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.519849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 895/1780] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:14:44.523252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.524901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.531851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 886/1781] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:44.538180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c73f85-9f65-49ec-bb4f-b3c52bdabf14 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.539344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.539635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.539951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.542951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa8d1d-956a-4e57-801b-f6d6bee7c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.543872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8d1d-956a-4e57-801b-f6d6bee7c763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.544318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8d1d-956a-4e57-801b-f6d6bee7c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.544597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa8d1d-956a-4e57-801b-f6d6bee7c763 admin admin] PATH_INFO: `/v3/projects/de00ae32408f431a9b063c5d2aa724e5/users/b276e6a75293440e8b6a6ece4c7bb144/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.546936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8d1d-956a-4e57-801b-f6d6bee7c763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de00ae32408f431a9b063c5d2aa724e5, user_id=b276e6a75293440e8b6a6ece4c7bb144, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.549713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa8d1d-956a-4e57-801b-f6d6bee7c763 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.559759 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:44.561627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.592976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 896/1782] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:44 2022] PUT /identity/v3/projects/de00ae32408f431a9b063c5d2aa724e5/users/b276e6a75293440e8b6a6ece4c7bb144/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:44.608242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.608950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.609292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.635502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 887/1783] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:14:44.648603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.649512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] MFA Rules not processed for user `b276e6a75293440e8b6a6ece4c7bb144`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:44.652087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.664895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e8239-1f39-46c8-8b4f-6f03ff948a25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.677234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.678704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.679176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.679601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.681256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:14:44.681520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.683666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.708623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 888/1784] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:14:44.713917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.729400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6498b1-0658-4c43-aa34-2b30f468e089 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.736230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.737092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.737333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.737686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.738816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.747119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.758296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 897/1785] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:44.776661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.778221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.835484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17050671-e077-4aa8-a5fe-4d5b0c536633 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.839089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.839735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.840063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.840341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.842208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:44.862938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 889/1786] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:44 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:14:44.867372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:44.912681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.915076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:44.932391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 898/1787] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:44.957733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2931f1-17b8-45f7-bb16-63d9f9903772 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:44.965933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:44.966680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:44.967038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:44.967323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:44.968446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:44.970661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:45.090124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 890/1788] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:44 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:14:45.094452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:45.106805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:45.124239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053109b-8fd1-4158-8a79-02d474a720ab service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:45.136545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:45.137540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:45.137836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:45.140570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:45.141421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:45.144698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:45.177825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:45.178197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 899/1789] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:45.202188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541a3be-02a3-4f3e-9225-feaa0b7cbe24 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:45.208721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5befb7-70c7-48a2-8bd3-764807b26dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:45.209390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5befb7-70c7-48a2-8bd3-764807b26dba admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:45.209855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5befb7-70c7-48a2-8bd3-764807b26dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:45.210273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5befb7-70c7-48a2-8bd3-764807b26dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:45.211294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5befb7-70c7-48a2-8bd3-764807b26dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:45.212985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5befb7-70c7-48a2-8bd3-764807b26dba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:45.245002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:45.245251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 891/1790] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:45.261071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039c4d1-e082-4eae-928c-c25e90cab2dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:45.273085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:45.274899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:45.275197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:45.284113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] PATH_INFO: `/v3/projects/cb86fd43b7b844689a7dccecaa6ffff5/users/7ec34c62bda141908d04cb0aafe4d5d7/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:45.315971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb86fd43b7b844689a7dccecaa6ffff5, user_id=7ec34c62bda141908d04cb0aafe4d5d7, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:45.317875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:45.399703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 900/1791] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:45 2022] PUT /identity/v3/projects/cb86fd43b7b844689a7dccecaa6ffff5/users/7ec34c62bda141908d04cb0aafe4d5d7/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:45.411648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:45.412314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:45.412403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:45.516700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] MFA Rules not processed for user `7ec34c62bda141908d04cb0aafe4d5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:45.518263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:45.650140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 892/1792] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:45.655234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:45.671407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:45.754295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0009301-d58c-4259-8d2f-41cb4d085685 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:45.760338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:45.761133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:45.761499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:45.761831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:45.762712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:45.765795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:45.918904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:45.920670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 901/1793] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:14:45 2022] POST /identity/v3/projects => generated 391 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:45.937613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739800a-e9db-459a-a629-d5957dea5059 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:46.164458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:46.165568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:46.166037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:46.166537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:46.167857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:46.171881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:46.262638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 893/1794] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:14:45 2022] POST /identity/v3/users => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:14:46.269713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:46.309603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f042a7-7713-4a47-86a8-20d6502fb8e6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:46.313008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:46.324098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:46.325008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:46.325531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:46.326181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:46.327416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:46.329980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:46.354248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 902/1795] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:46.355607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:46.372296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfcbe2-b4a8-4393-af60-fcab5cd72754 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:46.383044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:46.385016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:46.385539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:46.386046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] PATH_INFO: `/v3/projects/d802842fd3234fc08bc035f6fea8703b/users/a8888c3c1c9e4a5382a3d7353212eed5/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:46.444735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d802842fd3234fc08bc035f6fea8703b, user_id=a8888c3c1c9e4a5382a3d7353212eed5, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:46.453936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:46.548716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 894/1796] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:46 2022] PUT /identity/v3/projects/d802842fd3234fc08bc035f6fea8703b/users/a8888c3c1c9e4a5382a3d7353212eed5/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:46.553024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:46.572525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ecac0-a835-4ed5-a8fd-0bc735870c4f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:46.718357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e932e-2295-4918-8567-c015eb4f0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:46.719238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e932e-2295-4918-8567-c015eb4f0c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:46.720700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e932e-2295-4918-8567-c015eb4f0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:46.722818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e932e-2295-4918-8567-c015eb4f0c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:46.723540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e932e-2295-4918-8567-c015eb4f0c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:46.727507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e932e-2295-4918-8567-c015eb4f0c16 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:46.787363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 903/1797] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:14:46.788544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:46.806497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50fb28-8dc2-4282-8f5a-e0293cf60347 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:46.829285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:46.830209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:46.830496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:46.831024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] PATH_INFO: `/v3/projects/d802842fd3234fc08bc035f6fea8703b/users/a8888c3c1c9e4a5382a3d7353212eed5/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:46.845018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d802842fd3234fc08bc035f6fea8703b, user_id=a8888c3c1c9e4a5382a3d7353212eed5, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:46.846796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:46.876755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 895/1798] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:14:46 2022] PUT /identity/v3/projects/d802842fd3234fc08bc035f6fea8703b/users/a8888c3c1c9e4a5382a3d7353212eed5/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:14:46.888913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:46.889204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:46.889583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:46.922638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] MFA Rules not processed for user `a8888c3c1c9e4a5382a3d7353212eed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:46.924095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:47.032336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:47.075633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 904/1799] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:47.383101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:47.440404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:47.577236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d90d5-9465-4d5e-81f1-3bfef49dc15e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:47.577236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:47.577236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:47.577236 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:47.578367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:47.578367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:47.578367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:47.578367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 896/1800] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:49.097057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:49.108608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b32183-de21-487a-a789-27f8bb1a83d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:49.112904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:49.113559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:49.113914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:49.114314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:49.173249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:49.174801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:49.184176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 905/1801] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:49.557264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:49.600262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:54.045019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:54.053354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f097-4ca8-472c-a729-73d8029daad2 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:54.057086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493c04-4e69-47e9-a53d-29a289d7aed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:54.057736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493c04-4e69-47e9-a53d-29a289d7aed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:54.058063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493c04-4e69-47e9-a53d-29a289d7aed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:54.058340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493c04-4e69-47e9-a53d-29a289d7aed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:54.138471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493c04-4e69-47e9-a53d-29a289d7aed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:54.139999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493c04-4e69-47e9-a53d-29a289d7aed3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:54.150291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 897/1802] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:56.925960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:56.992153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b018c7-8a0f-4811-9ac8-a777ea563c48 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:56.996627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:56.997519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:56.997799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:56.998102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] PATH_INFO: `/v3/users/7ec34c62bda141908d04cb0aafe4d5d7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:56.999244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec34c62bda141908d04cb0aafe4d5d7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:57.001228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:57.072937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:57.171654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec34c62bda141908d04cb0aafe4d5d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:57.184401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec34c62bda141908d04cb0aafe4d5d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:57.185638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec34c62bda141908d04cb0aafe4d5d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:57.186248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec34c62bda141908d04cb0aafe4d5d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:57.259840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec34c62bda141908d04cb0aafe4d5d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:57.274306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 906/1803] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:56 2022] DELETE /identity/v3/users/7ec34c62bda141908d04cb0aafe4d5d7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:57.279263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:57.279766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:57.280233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:57.298003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:57.303476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:57.358379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:57.370666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 898/1804] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:14:57.380803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:57.382470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:57.474283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f9341-1bc8-4b61-8b4a-355880bac520 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:57.479440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:57.480245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:57.480636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:57.481020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:57.497802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:57.510485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:57.527984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 907/1805] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:14:58.090689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:58.092856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:58.105221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3afd96-34f6-4fc3-bc1c-28e373bec0c5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:58.111251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:58.114819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:58.114819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:58.114819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] PATH_INFO: `/v3/projects/cb86fd43b7b844689a7dccecaa6ffff5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:58.114819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb86fd43b7b844689a7dccecaa6ffff5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:58.116744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:58.259875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb86fd43b7b844689a7dccecaa6ffff5', 'request_id': 'req-982a4b77-cd96-41a0-90b9-b3f409548300'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.266188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb86fd43b7b844689a7dccecaa6ffff5', 'request_id': 'req-982a4b77-cd96-41a0-90b9-b3f409548300'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.271466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb86fd43b7b844689a7dccecaa6ffff5', 'request_id': 'req-982a4b77-cd96-41a0-90b9-b3f409548300'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.332934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] The token cache is being invalidate because project cb86fd43b7b844689a7dccecaa6ffff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:58.333499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.333968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.335528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 899/1806] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:58 2022] DELETE /identity/v3/projects/cb86fd43b7b844689a7dccecaa6ffff5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:58.339404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:58.350058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b0e4-92b6-4da7-a3a5-b3f087e69b4e service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:58.409636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:58.410515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:58.410800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:58.411077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] PATH_INFO: `/v3/users/a8888c3c1c9e4a5382a3d7353212eed5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:58.412401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8888c3c1c9e4a5382a3d7353212eed5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:58.414466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:58.583079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8888c3c1c9e4a5382a3d7353212eed5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.584201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:58.596118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8888c3c1c9e4a5382a3d7353212eed5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.596812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8888c3c1c9e4a5382a3d7353212eed5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.597418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8888c3c1c9e4a5382a3d7353212eed5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.642691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24ba8edf-0cec-4540-8a76-3bcae1ce70da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8888c3c1c9e4a5382a3d7353212eed5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:58.656269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 908/1807] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:14:58 2022] DELETE /identity/v3/users/a8888c3c1c9e4a5382a3d7353212eed5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:59.440953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:14:59.450895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:59.472615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a4b77-cd96-41a0-90b9-b3f409548300 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:14:59.608943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:14:59.609951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:59.610242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:59.610522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] PATH_INFO: `/v3/projects/d802842fd3234fc08bc035f6fea8703b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:59.612708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d802842fd3234fc08bc035f6fea8703b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:14:59.614884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:14:59.750534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd802842fd3234fc08bc035f6fea8703b', 'request_id': 'req-bd66cc56-0900-4e7b-87fd-8338943873ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:59.773058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd802842fd3234fc08bc035f6fea8703b', 'request_id': 'req-bd66cc56-0900-4e7b-87fd-8338943873ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:59.780417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd802842fd3234fc08bc035f6fea8703b', 'request_id': 'req-bd66cc56-0900-4e7b-87fd-8338943873ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:59.796691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7bb83-9107-4485-8a78-2a922ea71bbb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:59.797585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7bb83-9107-4485-8a78-2a922ea71bbb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:59.798212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7bb83-9107-4485-8a78-2a922ea71bbb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:59.800227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 909/1808] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:14:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:14:59.851356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:59.853509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:59.854394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:59.878774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] The token cache is being invalidate because project d802842fd3234fc08bc035f6fea8703b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:14:59.879074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:59.880161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bd66cc56-0900-4e7b-87fd-8338943873ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:14:59.895692 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 900/1809] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:14:59 2022] DELETE /identity/v3/projects/d802842fd3234fc08bc035f6fea8703b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:14:59.904963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0539c-91d0-41ab-b2e3-0406549eeec2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:14:59.905393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0539c-91d0-41ab-b2e3-0406549eeec2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:14:59.905830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0539c-91d0-41ab-b2e3-0406549eeec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:14:59.909981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:59.912369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:59.937304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6ba0539c-91d0-41ab-b2e3-0406549eeec2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:14:59.939788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ba0539c-91d0-41ab-b2e3-0406549eeec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:14:59.947109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:00.079917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 901/1810] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:00.088390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.093720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.095867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.118313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 910/1811] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:14:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:00.151776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:00.152234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:00.169200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 902/1812] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:00.173226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.193040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8176d-f3b2-48f9-92a8-1f3b7ab33052 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.203635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.204888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.205377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.206536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.208018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:00.208606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.210494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.233089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 911/1813] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:00.237346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.260303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed5a61-ce49-444d-b734-e5bef0bc09ce None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.264378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.266775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.268222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.272245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.273151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.275557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.402850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 903/1814] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:00 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:00.403012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.406300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:00.408163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.441650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95997f7-333e-4273-884d-6b4c589d6a9c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.528721 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea387bf3-36c3-48ff-970a-91532a3593cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.537316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.538075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.538370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.538654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.539414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.541771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.544079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.547490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.547490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.547490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.565790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.568702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.582368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 912/1815] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:00.652575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 904/1816] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:00 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:00.656447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.671034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db90a2-2db3-4c2f-8284-6d7a4cda433d service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.677139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.678088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.680774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.680774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.680774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.681937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.696677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 913/1817] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:00.700551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.712513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b586e74-ba27-48cb-99a2-4cccc83985ba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.718927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87738f0-eda2-454b-b1d1-989742f96e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.718927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87738f0-eda2-454b-b1d1-989742f96e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.719934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87738f0-eda2-454b-b1d1-989742f96e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.720439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87738f0-eda2-454b-b1d1-989742f96e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.721353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87738f0-eda2-454b-b1d1-989742f96e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.723470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87738f0-eda2-454b-b1d1-989742f96e09 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.742087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 905/1818] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:00.752550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:00.763755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fcecd-0b3c-44c2-b7ff-9d739d1f9ad7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:00.768997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:00.770725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.771108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.771486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] PATH_INFO: `/v3/projects/4c3c217e02f546a1919cc0ce1e868661/users/31d0c7185ccf4d7ebdd8ae820ba2b48a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.792759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3c217e02f546a1919cc0ce1e868661, user_id=31d0c7185ccf4d7ebdd8ae820ba2b48a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:00.796514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:00.799127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:00.877325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 914/1819] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:00 2022] PUT /identity/v3/projects/4c3c217e02f546a1919cc0ce1e868661/users/31d0c7185ccf4d7ebdd8ae820ba2b48a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:00.889211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:00.890299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:00.890646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:00.925443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] MFA Rules not processed for user `31d0c7185ccf4d7ebdd8ae820ba2b48a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:00.926841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:01.002181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:01.026900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 906/1820] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:01.065636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:01.069263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:01.135024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ac82-f277-4f94-b803-654315a40020 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:01.138921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92ea87-2de8-4bb0-a639-4622e05f5078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:01.139831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea87-2de8-4bb0-a639-4622e05f5078 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:01.139985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea87-2de8-4bb0-a639-4622e05f5078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:01.140253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92ea87-2de8-4bb0-a639-4622e05f5078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:01.150051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92ea87-2de8-4bb0-a639-4622e05f5078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:01.151636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92ea87-2de8-4bb0-a639-4622e05f5078 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:01.162104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 915/1821] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:07.731535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:07.732976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:07.798796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95190995-4f6b-49c1-b808-f8ea38b3553f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:07.803323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:07.804262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:07.804547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:07.804837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] PATH_INFO: `/v3/users/3a393beddb714826b4d3315aacf81ebd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:07.806045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a393beddb714826b4d3315aacf81ebd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:07.808007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:08.020520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a393beddb714826b4d3315aacf81ebd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:08.051324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a393beddb714826b4d3315aacf81ebd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:08.055246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a393beddb714826b4d3315aacf81ebd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:08.139547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a393beddb714826b4d3315aacf81ebd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:08.140121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a393beddb714826b4d3315aacf81ebd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:08.157540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 907/1822] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:07 2022] DELETE /identity/v3/users/3a393beddb714826b4d3315aacf81ebd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:08.162834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:08.163357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:08.163446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:08.182026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:08.183157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:08.255548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 916/1823] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:08.265758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:08.267442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:08.338314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc4740-2ce0-4dd4-a0cd-5dfe94f42a69 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:08.342080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:08.343001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:08.343817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:08.344161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:08.356265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:08.357732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:08.371696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 908/1824] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:09.003509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:09.005239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:09.022671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866016a-68e9-4279-bb5a-0ad97ca8c4e3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:09.035769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:09.043728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:09.044116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:09.044406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] PATH_INFO: `/v3/projects/a85c56f2a3b848c9bb67f7e0972e0668` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:09.048432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85c56f2a3b848c9bb67f7e0972e0668)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:09.050429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:09.180732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85c56f2a3b848c9bb67f7e0972e0668', 'request_id': 'req-376b2d3c-193d-425e-8680-54dfa82e5fb5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.297340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85c56f2a3b848c9bb67f7e0972e0668', 'request_id': 'req-376b2d3c-193d-425e-8680-54dfa82e5fb5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.317089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85c56f2a3b848c9bb67f7e0972e0668', 'request_id': 'req-376b2d3c-193d-425e-8680-54dfa82e5fb5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.330458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] The token cache is being invalidate because project a85c56f2a3b848c9bb67f7e0972e0668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:09.331110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.332018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.336935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 917/1825] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:09 2022] DELETE /identity/v3/projects/a85c56f2a3b848c9bb67f7e0972e0668 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:09.338524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:09.350254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cf280-dcbf-4b8a-9c03-9d7210e39f5f service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:09.358772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:09.426292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:09.428084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:09.428368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:09.428829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] PATH_INFO: `/v3/users/1d16b5bf77414882a6295d3b9185ad9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:09.436389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d16b5bf77414882a6295d3b9185ad9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:09.436389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:09.631392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d16b5bf77414882a6295d3b9185ad9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.656726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d16b5bf77414882a6295d3b9185ad9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.658040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d16b5bf77414882a6295d3b9185ad9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.727997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d16b5bf77414882a6295d3b9185ad9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.728629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ebf701d0-8ba3-4392-bce6-f75ab288e319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d16b5bf77414882a6295d3b9185ad9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:09.742703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 909/1826] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:09 2022] DELETE /identity/v3/users/1d16b5bf77414882a6295d3b9185ad9a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:10.181333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:10.182819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:10.198302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b2d3c-193d-425e-8680-54dfa82e5fb5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:10.219825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:10.260149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:10.260903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.261182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.261454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] PATH_INFO: `/v3/projects/bf7775d2761741ff90481b2e44eef54b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.262631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7775d2761741ff90481b2e44eef54b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:10.264650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:10.379787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7775d2761741ff90481b2e44eef54b', 'request_id': 'req-abd23d8b-fe6d-4a47-ba78-03467fb4c004'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:10.453733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7775d2761741ff90481b2e44eef54b', 'request_id': 'req-abd23d8b-fe6d-4a47-ba78-03467fb4c004'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:10.460806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7775d2761741ff90481b2e44eef54b', 'request_id': 'req-abd23d8b-fe6d-4a47-ba78-03467fb4c004'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:10.471624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] The token cache is being invalidate because project bf7775d2761741ff90481b2e44eef54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:10.471939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:10.472578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-abd23d8b-fe6d-4a47-ba78-03467fb4c004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:10.474142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 918/1827] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:10 2022] DELETE /identity/v3/projects/bf7775d2761741ff90481b2e44eef54b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:10.479053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.479511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.479624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.498041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:10.499495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:10.560819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 910/1828] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:10.568781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.569158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.569442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.589942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:10.591432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:10.600832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 919/1829] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:10.605315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:10.616471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bbeeef-4702-465b-b947-e7c5c8b6b5bf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:10.621216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:10.621868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.622152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.622427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.623264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:10.623485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:10.625170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:10.640744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 911/1830] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:10.643781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:10.653555 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dcbbd-b9bd-4f60-8460-3011598c6a49 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:10.659697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:10.660407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.660654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.660926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.661614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:10.663519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:10.783383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 920/1831] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:10 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:10.787317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:10.799407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af73ce0-d20c-429c-b9ee-98fe37b6cfb5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:10.818214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:10.868925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:10.869599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.869881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.870156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.870853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:10.873127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:10.950852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 912/1832] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:10 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:10.954967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:10.965547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad26932-01f3-4cef-a464-fcdc3e061fd8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:10.970287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:10.970952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:10.971232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:10.971510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:10.972275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:10.973880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:10.985751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 921/1833] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:10.990057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.002137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505850f-43a6-4cef-8a22-9d76b63e22c2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.007515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d0448-6617-4164-99e4-15e702f4b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.008228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d0448-6617-4164-99e4-15e702f4b71c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.008523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d0448-6617-4164-99e4-15e702f4b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.008807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d0448-6617-4164-99e4-15e702f4b71c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.009538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d0448-6617-4164-99e4-15e702f4b71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.011147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d0448-6617-4164-99e4-15e702f4b71c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.021788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 913/1834] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:11.026045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.036005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68642550-5f15-4f5b-ba0c-d82fe18b6306 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.040545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.041410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.041696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.041973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] PATH_INFO: `/v3/projects/11e8c8dbe1b0473eb57788cde823a92b/users/2dca8fee91c14a448d75a6ac0fabf6de/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.056729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e8c8dbe1b0473eb57788cde823a92b, user_id=2dca8fee91c14a448d75a6ac0fabf6de, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.059370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.117318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 922/1835] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:11 2022] PUT /identity/v3/projects/11e8c8dbe1b0473eb57788cde823a92b/users/2dca8fee91c14a448d75a6ac0fabf6de/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:11.129051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.129340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.129629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.157731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] MFA Rules not processed for user `2dca8fee91c14a448d75a6ac0fabf6de`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:11.158954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:11.223972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 914/1836] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:11.228480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.277530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:11.292860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29356ee-20e7-4fe6-9d70-9b59b7d13c3e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.297959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.298796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.299241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.299669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.300741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.302799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.370176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 923/1837] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:11 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:11.379863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.385980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa789b-ef3d-470e-b461-dd843c6e60c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.457482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.458164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.458451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.458737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.459465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.461452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.517121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 915/1838] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:11 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:11.521013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.531386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2646-0591-49a4-937f-e699d46a16f4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.536032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.536680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.536961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.537237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.537984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.539579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.550488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 924/1839] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:11.554620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.587064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2521be5-dab2-4650-80db-de3f3ad92aa7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.591709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.592785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.593064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.593442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] PATH_INFO: `/v3/projects/2ca0788332b44170858faa1432c5bf51/users/2c32c1d32a3d4a96af07de55e0bfc69b/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.605225 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:11.608158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca0788332b44170858faa1432c5bf51, user_id=2c32c1d32a3d4a96af07de55e0bfc69b, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.611652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.687894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 916/1840] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:11 2022] PUT /identity/v3/projects/2ca0788332b44170858faa1432c5bf51/users/2c32c1d32a3d4a96af07de55e0bfc69b/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:11.691668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.701395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5d1dc-6c2e-4769-b453-5bfd515e0f96 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.763100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398270c-f6c1-4ba4-9271-d077ea1d1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.763786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398270c-f6c1-4ba4-9271-d077ea1d1cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.764105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398270c-f6c1-4ba4-9271-d077ea1d1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.764385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398270c-f6c1-4ba4-9271-d077ea1d1cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.765174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398270c-f6c1-4ba4-9271-d077ea1d1cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.766918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398270c-f6c1-4ba4-9271-d077ea1d1cd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.779936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 925/1841] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:11.784585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.798460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e795e61-3334-45d0-8b56-3448b8001594 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:11.807432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:11.808498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.808789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.809074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] PATH_INFO: `/v3/projects/2ca0788332b44170858faa1432c5bf51/users/2c32c1d32a3d4a96af07de55e0bfc69b/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.811531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca0788332b44170858faa1432c5bf51, user_id=2c32c1d32a3d4a96af07de55e0bfc69b, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:11.823454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:11.837441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 917/1842] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:11 2022] PUT /identity/v3/projects/2ca0788332b44170858faa1432c5bf51/users/2c32c1d32a3d4a96af07de55e0bfc69b/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:11.848050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:11.848341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:11.848622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:11.883422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] MFA Rules not processed for user `2c32c1d32a3d4a96af07de55e0bfc69b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:11.884873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:11.969755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 926/1843] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:11.981809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:11.983663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:12.046299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13e743-05d2-4742-af63-d4b5bdd9de55 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:12.050019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:12.058952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:12.058952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:12.058952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:12.060756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:12.066644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:12.072914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 918/1844] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:12.212505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:12.213904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:12.225571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d148b8-5e6b-47d2-8617-98f43be71f3f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:12.229253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c2dc5-ad38-4cbb-b3db-ae7b33a7043c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:12.229871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c2dc5-ad38-4cbb-b3db-ae7b33a7043c service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:12.230157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c2dc5-ad38-4cbb-b3db-ae7b33a7043c service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:12.230430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c2dc5-ad38-4cbb-b3db-ae7b33a7043c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:12.271063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:12.286799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c2dc5-ad38-4cbb-b3db-ae7b33a7043c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:12.288281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c2dc5-ad38-4cbb-b3db-ae7b33a7043c service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:12.297623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 927/1845] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:17.701073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:17.769122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91366d39-b71c-4cda-8a50-b7ddffa9b4b5 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:17.774762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:17.775616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:17.775933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:17.776211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] PATH_INFO: `/v3/users/2dca8fee91c14a448d75a6ac0fabf6de` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:17.777416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dca8fee91c14a448d75a6ac0fabf6de)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:17.779346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:17.953523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dca8fee91c14a448d75a6ac0fabf6de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:17.965835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dca8fee91c14a448d75a6ac0fabf6de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:17.966562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dca8fee91c14a448d75a6ac0fabf6de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:18.030632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dca8fee91c14a448d75a6ac0fabf6de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:18.031289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dca8fee91c14a448d75a6ac0fabf6de'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:18.041068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:18.045314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 919/1846] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:17 2022] DELETE /identity/v3/users/2dca8fee91c14a448d75a6ac0fabf6de => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:18.050003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:18.050481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:18.050570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:18.068595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:18.069821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:18.131142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 928/1847] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:18.141545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:18.143030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:18.207552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e73c-456c-41f6-9f8a-81de3ddda163 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:18.212550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:18.213281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:18.213564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:18.213840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:18.226038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:18.227577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:18.238427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 920/1848] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:18.736282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:18.738257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:18.750708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64e09-53ea-4d0c-aa63-ca6c180fc908 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:18.755316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:18.756236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:18.756516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:18.756789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] PATH_INFO: `/v3/projects/11e8c8dbe1b0473eb57788cde823a92b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:18.757966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e8c8dbe1b0473eb57788cde823a92b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:18.760533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:18.900907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e8c8dbe1b0473eb57788cde823a92b', 'request_id': 'req-ecebb75f-ecb6-47ca-9653-e9366df5335c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:18.991679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e8c8dbe1b0473eb57788cde823a92b', 'request_id': 'req-ecebb75f-ecb6-47ca-9653-e9366df5335c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.001134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e8c8dbe1b0473eb57788cde823a92b', 'request_id': 'req-ecebb75f-ecb6-47ca-9653-e9366df5335c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.013042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] The token cache is being invalidate because project 11e8c8dbe1b0473eb57788cde823a92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:19.013418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.014177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.016171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 929/1849] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:18 2022] DELETE /identity/v3/projects/11e8c8dbe1b0473eb57788cde823a92b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:19.020126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:19.029886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd2dbd-43ff-4bf4-af5f-81a9123a7cca service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:19.109701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:19.111416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:19.111568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:19.111866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] PATH_INFO: `/v3/users/2c32c1d32a3d4a96af07de55e0bfc69b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:19.113183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c32c1d32a3d4a96af07de55e0bfc69b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:19.115407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:19.819201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c32c1d32a3d4a96af07de55e0bfc69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.835790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c32c1d32a3d4a96af07de55e0bfc69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.836693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c32c1d32a3d4a96af07de55e0bfc69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.957116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c32c1d32a3d4a96af07de55e0bfc69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.958037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b742952-15cd-44e4-94fa-9d83715ab03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c32c1d32a3d4a96af07de55e0bfc69b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:19.973057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 921/1850] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:19 2022] DELETE /identity/v3/users/2c32c1d32a3d4a96af07de55e0bfc69b => generated 0 bytes in 953 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:20.525864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:20.527994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:20.548394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb75f-ecb6-47ca-9653-e9366df5335c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:20.636535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:20.638173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:20.638470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:20.638755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] PATH_INFO: `/v3/projects/2ca0788332b44170858faa1432c5bf51` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:20.640423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca0788332b44170858faa1432c5bf51)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:20.642450 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:20.650859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:20.784821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca0788332b44170858faa1432c5bf51', 'request_id': 'req-cf059793-1b60-4336-96b1-c41fab53fbe9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:20.847852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca0788332b44170858faa1432c5bf51', 'request_id': 'req-cf059793-1b60-4336-96b1-c41fab53fbe9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:20.855044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca0788332b44170858faa1432c5bf51', 'request_id': 'req-cf059793-1b60-4336-96b1-c41fab53fbe9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:20.866587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] The token cache is being invalidate because project 2ca0788332b44170858faa1432c5bf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:20.866975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:20.867645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf059793-1b60-4336-96b1-c41fab53fbe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:20.869225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 930/1851] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:20 2022] DELETE /identity/v3/projects/2ca0788332b44170858faa1432c5bf51 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:20.875135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:20.875666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:20.875859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:20.898720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:20.900399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:20.919234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:20.965391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 922/1852] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:20.973679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:20.974076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:20.974453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:20.994430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:20.995766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:21.007249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 931/1853] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:21.010424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.020277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51de26-3e9a-4d1f-abf6-d0f377b89381 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.026669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.028817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.028817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.028817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.029267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:21.029719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.033133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.045482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 923/1854] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:21.050623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.060607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73a8f-6c82-419e-952c-954d7ceeb676 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.065658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.067617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.067617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.067617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.068152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.070173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.174752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 932/1855] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:21 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:21.175930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.185804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d700b-c453-4eb8-99f4-1c4cc0013394 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.266488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.267437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.267985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.268412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.269284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.271453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.345499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 924/1856] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:21 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:21.349744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.360576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319adfc8-68e6-4083-aab6-73102a29595f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.365806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.366476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.367286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.367286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.367937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.369593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.382267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 933/1857] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:21.386163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.397200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e41bb-cbac-4402-aa3c-b7dd645d1788 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.402921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68aac1-816a-438d-97a0-a099cd43e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.403598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68aac1-816a-438d-97a0-a099cd43e347 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.403916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68aac1-816a-438d-97a0-a099cd43e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.404196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68aac1-816a-438d-97a0-a099cd43e347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.404924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68aac1-816a-438d-97a0-a099cd43e347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.406752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68aac1-816a-438d-97a0-a099cd43e347 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.417440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 925/1858] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:21.422223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.437817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c780-33c5-4fb4-a3c1-3f3b5f7b54e0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.450494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.450494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.450820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.451164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] PATH_INFO: `/v3/projects/72683484a35c4a64912f523e19529bd8/users/f71be1c8f3774469afa4d56e2c66140a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.471139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72683484a35c4a64912f523e19529bd8, user_id=f71be1c8f3774469afa4d56e2c66140a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.474103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.535145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 934/1859] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:21 2022] PUT /identity/v3/projects/72683484a35c4a64912f523e19529bd8/users/f71be1c8f3774469afa4d56e2c66140a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:21.547079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1718-5873-418a-be53-21f73f684994 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.547449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1718-5873-418a-be53-21f73f684994 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.547733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c1718-5873-418a-be53-21f73f684994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.576199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b78c1718-5873-418a-be53-21f73f684994 None None] MFA Rules not processed for user `f71be1c8f3774469afa4d56e2c66140a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:21.577719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b78c1718-5873-418a-be53-21f73f684994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:21.660460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 926/1860] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:21.661229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.738672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7d973-8198-404f-afdd-25a6bbe0dee7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.743646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.744397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.744675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.744947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.745639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.747541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:21.829519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 935/1861] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:21 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:21.832292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1718-5873-418a-be53-21f73f684994 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:21.844808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c1718-5873-418a-be53-21f73f684994 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:21.864586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:21.913383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:21.914155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:21.914408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:21.914690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:21.915402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:21.917379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:22.012842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 927/1862] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:21 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:22.014420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:22.026168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcde8e-3c57-45e5-9aaa-f93f74cf6cad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:22.032181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:22.032965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:22.033352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:22.033728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:22.034558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:22.036446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:22.051609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 936/1863] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:22.054263 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:22.065968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006605f8-db81-4498-8398-62f6979f7150 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:22.072414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:22.077040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:22.077040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:22.077040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] PATH_INFO: `/v3/projects/43f0483f3f0649f4b97f2753c6860daf/users/96f1f7facd1346eb96d0cf5cbd719797/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:22.099452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f0483f3f0649f4b97f2753c6860daf, user_id=96f1f7facd1346eb96d0cf5cbd719797, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:22.102693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:22.153957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 928/1864] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:22 2022] PUT /identity/v3/projects/43f0483f3f0649f4b97f2753c6860daf/users/96f1f7facd1346eb96d0cf5cbd719797/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:22.159481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:22.167349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:22.173628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41700-4665-460d-9415-80d8d886b77e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:22.263073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aabb0-0cb1-4ea5-b025-032bee4685db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:22.263073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aabb0-0cb1-4ea5-b025-032bee4685db admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:22.263073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aabb0-0cb1-4ea5-b025-032bee4685db admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:22.263073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aabb0-0cb1-4ea5-b025-032bee4685db admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:22.271024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aabb0-0cb1-4ea5-b025-032bee4685db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:22.271024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aabb0-0cb1-4ea5-b025-032bee4685db admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:22.277464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 937/1865] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:22.282586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:22.295174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a908-b97f-4892-b4c7-8c7e43b85a6e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:22.303420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:22.304382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:22.304667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:22.304942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] PATH_INFO: `/v3/projects/43f0483f3f0649f4b97f2753c6860daf/users/96f1f7facd1346eb96d0cf5cbd719797/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:22.306944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f0483f3f0649f4b97f2753c6860daf, user_id=96f1f7facd1346eb96d0cf5cbd719797, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:22.309724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:22.322720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 929/1866] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:22 2022] PUT /identity/v3/projects/43f0483f3f0649f4b97f2753c6860daf/users/96f1f7facd1346eb96d0cf5cbd719797/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:22.334207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:22.334502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:22.334786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:22.363495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] MFA Rules not processed for user `96f1f7facd1346eb96d0cf5cbd719797`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:22.364960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:22.453350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 938/1867] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:22.466331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:22.469113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:22.544556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf9afb-4b58-475c-b7e8-e771f0a2c3b3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:22.549409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:22.550178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:22.551002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:22.551002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:22.560776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:22.562338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:22.572074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 930/1868] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:23.606196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:23.618120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd29bd-155c-49fd-a0ef-9eeda5d46e6c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:23.623639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f1f7facd1346eb96d0cf5cbd719797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f0483f3f0649f4b97f2753c6860daf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:23.624998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:23.625993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:23.626397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:23.627167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:23.627502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:23.629359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:23.643084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 939/1869] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:23.647502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:23.657014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fee9ef-7c5e-4d24-87ac-c02ec0aa8dbd service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:23.662445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f1f7facd1346eb96d0cf5cbd719797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f0483f3f0649f4b97f2753c6860daf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:23.663534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:23.663852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:23.664138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:23.664913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:23.667392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:23.780172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 931/1870] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:23 2022] POST /identity/v3/projects => generated 355 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:23.782610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:23.794791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7bb87-ad37-40f0-9baa-3a9113fce7a2 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:23.868958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f1f7facd1346eb96d0cf5cbd719797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f0483f3f0649f4b97f2753c6860daf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:23.869739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:23.870104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:23.870467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:23.871278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:23.871687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:23.873612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:23.890526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 940/1871] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:23.931626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:23.942833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9492b-988b-4348-be36-5b517d40bee6 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:23.948654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96f1f7facd1346eb96d0cf5cbd719797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43f0483f3f0649f4b97f2753c6860daf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:23.949795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:23.950281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:23.950991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] PATH_INFO: `/v3/projects/51ef08bba1fb4f8a9919a65b7216f5af` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:23.953057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51ef08bba1fb4f8a9919a65b7216f5af)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:23.957209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:24.063346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:24.066618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ef08bba1fb4f8a9919a65b7216f5af', 'request_id': 'req-a3b1ba92-0422-40d9-927c-59cfc782b78e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:24.076956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ef08bba1fb4f8a9919a65b7216f5af', 'request_id': 'req-a3b1ba92-0422-40d9-927c-59cfc782b78e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:24.083633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ef08bba1fb4f8a9919a65b7216f5af', 'request_id': 'req-a3b1ba92-0422-40d9-927c-59cfc782b78e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:24.179419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] The token cache is being invalidate because project 51ef08bba1fb4f8a9919a65b7216f5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:24.179715 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:24.180492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3b1ba92-0422-40d9-927c-59cfc782b78e tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:24.182170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 932/1872] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:23 2022] DELETE /identity/v3/projects/51ef08bba1fb4f8a9919a65b7216f5af => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:24.908508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:24.910328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:24.920842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:24.983865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57e26-d258-4372-90f9-b463cfdab3e0 tempest-VolumeQuotaClassesTest-519517891 tempest-VolumeQuotaClassesTest-519517891-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:25.047725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:25.048886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:25.049165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:25.049444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] PATH_INFO: `/v3/users/f71be1c8f3774469afa4d56e2c66140a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:25.050800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71be1c8f3774469afa4d56e2c66140a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:25.052812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:25.217123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71be1c8f3774469afa4d56e2c66140a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:25.230732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71be1c8f3774469afa4d56e2c66140a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:25.231420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71be1c8f3774469afa4d56e2c66140a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:25.232051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71be1c8f3774469afa4d56e2c66140a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:25.314847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71be1c8f3774469afa4d56e2c66140a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:25.328123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 941/1873] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:24 2022] DELETE /identity/v3/users/f71be1c8f3774469afa4d56e2c66140a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:25.332678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:25.333146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:25.333268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:25.352501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:25.353689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:25.413168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 933/1874] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:25.427534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:25.429096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:25.468520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:25.490403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc68a5-f2d7-4759-b99e-48bfd34f589a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:25.494022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:25.494644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:25.494926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:25.495200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:25.504046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:25.505506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:25.514735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 942/1875] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:25.912586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:25.913766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:25.927383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9f7b-70de-4423-aaa0-bf98c7aa8e84 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:25.932418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:25.934365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:25.934782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:25.935200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] PATH_INFO: `/v3/projects/72683484a35c4a64912f523e19529bd8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:25.937213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72683484a35c4a64912f523e19529bd8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:25.939131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:26.035587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72683484a35c4a64912f523e19529bd8', 'request_id': 'req-f3d560d8-82b8-4000-9594-f2c6a0924e60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.041865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72683484a35c4a64912f523e19529bd8', 'request_id': 'req-f3d560d8-82b8-4000-9594-f2c6a0924e60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.048408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72683484a35c4a64912f523e19529bd8', 'request_id': 'req-f3d560d8-82b8-4000-9594-f2c6a0924e60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.109200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] The token cache is being invalidate because project 72683484a35c4a64912f523e19529bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:26.109482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.110122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.111773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 934/1876] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:25 2022] DELETE /identity/v3/projects/72683484a35c4a64912f523e19529bd8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:26.116227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:26.125998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc25d-ca34-41a6-8a00-9125cb19cc6c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:26.183257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:26.184166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:26.184450 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:26.184728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] PATH_INFO: `/v3/users/96f1f7facd1346eb96d0cf5cbd719797` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:26.185919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f1f7facd1346eb96d0cf5cbd719797)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:26.188124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:26.341324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f1f7facd1346eb96d0cf5cbd719797'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.354033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f1f7facd1346eb96d0cf5cbd719797'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.354702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f1f7facd1346eb96d0cf5cbd719797'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.355424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f1f7facd1346eb96d0cf5cbd719797'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.429304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685567e3-19a6-47d8-908a-3c4e990e13b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f1f7facd1346eb96d0cf5cbd719797'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:26.442391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 943/1877] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:26 2022] DELETE /identity/v3/users/96f1f7facd1346eb96d0cf5cbd719797 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:26.826248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:26.827770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:26.844360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d560d8-82b8-4000-9594-f2c6a0924e60 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:26.896543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:26.902222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:26.903083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:26.903368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:26.903648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] PATH_INFO: `/v3/projects/43f0483f3f0649f4b97f2753c6860daf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:26.904855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f0483f3f0649f4b97f2753c6860daf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:26.907447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.036986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f0483f3f0649f4b97f2753c6860daf', 'request_id': 'req-53a8a21a-129e-4418-9e88-9d8c571156cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:27.044188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f0483f3f0649f4b97f2753c6860daf', 'request_id': 'req-53a8a21a-129e-4418-9e88-9d8c571156cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:27.050764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f0483f3f0649f4b97f2753c6860daf', 'request_id': 'req-53a8a21a-129e-4418-9e88-9d8c571156cb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:27.149779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] The token cache is being invalidate because project 43f0483f3f0649f4b97f2753c6860daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:27.150074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:27.150705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-53a8a21a-129e-4418-9e88-9d8c571156cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:27.152297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 935/1878] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:26 2022] DELETE /identity/v3/projects/43f0483f3f0649f4b97f2753c6860daf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:27.157704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.158210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.158386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.178206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:27.179395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:27.228865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:27.240668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 944/1879] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:27.248544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.248947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.249275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.268960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:27.270094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:27.278279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 936/1880] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:27.283709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:27.293706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb098a-2d9b-4c54-8d5c-a9a555bfbbfb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:27.298553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:27.299207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.299494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.299773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.300528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:27.300860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:27.302466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.314475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 945/1881] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:27.319125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:27.329456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e64d-8677-429c-b96d-eb9193bbef02 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:27.334704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:27.335366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.335654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.335976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.336684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:27.338869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.436619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 937/1882] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:27 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:27.437940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:27.450277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e4072-97be-4894-9a56-77d23fdc6428 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:27.510195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:27.510870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.511165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.511512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.514982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:27.514982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.619422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 946/1883] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:27 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:27.627009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:27.637495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247d40b-a489-4f50-bc55-1e4070117f9c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:27.642993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:27.643733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.644050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.644331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.645124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:27.646915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.659865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 938/1884] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:27.661649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:27.671967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da5521-f438-460b-8b61-ddce59f13ea3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:27.676740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b8423-61d5-4a95-aa67-4003aaddad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:27.677397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8423-61d5-4a95-aa67-4003aaddad32 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.677683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8423-61d5-4a95-aa67-4003aaddad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.677964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b8423-61d5-4a95-aa67-4003aaddad32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.678691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8423-61d5-4a95-aa67-4003aaddad32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:27.680448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b8423-61d5-4a95-aa67-4003aaddad32 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.691070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 947/1885] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:27.695366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:27.706246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2867728-1778-4c41-b2d3-50673d5561d4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:27.711059 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:27.711971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.712363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.712681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] PATH_INFO: `/v3/projects/e9305a7333df4c9b898b18aa185c536f/users/3496bba1ef1f4c3ca6cab2bbe77a4304/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.733882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9305a7333df4c9b898b18aa185c536f, user_id=3496bba1ef1f4c3ca6cab2bbe77a4304, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:27.738142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:27.822637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 939/1886] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:27 2022] PUT /identity/v3/projects/e9305a7333df4c9b898b18aa185c536f/users/3496bba1ef1f4c3ca6cab2bbe77a4304/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:27.837009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89e639-4490-4617-91c0-202265c70447 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:27.837303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89e639-4490-4617-91c0-202265c70447 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:27.837585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89e639-4490-4617-91c0-202265c70447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:27.867145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3f89e639-4490-4617-91c0-202265c70447 None None] MFA Rules not processed for user `3496bba1ef1f4c3ca6cab2bbe77a4304`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:27.868599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3f89e639-4490-4617-91c0-202265c70447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:27.940559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 948/1887] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:27.945131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.006997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c7ebf-ef7c-4984-93df-c4179363832a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.012049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.015115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.015115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.015115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.015115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.016046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.105097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 940/1888] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:27 2022] POST /identity/v3/projects => generated 401 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:28.109780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89e639-4490-4617-91c0-202265c70447 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.120484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89e639-4490-4617-91c0-202265c70447 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.169813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:28.180739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.183826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.183826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.183826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.183826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.184783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.289372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 949/1889] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:28 2022] POST /identity/v3/users => generated 307 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:28.293611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.305308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260812d-f33d-452d-a5ef-25071d30b5b7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.310112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.310794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.311081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.312011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.313100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.314747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.317504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:28.333187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.333803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 941/1890] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:28.347905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07fc73-2913-478b-8189-ecabd9094e3b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.353010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.354357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.354673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.355036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] PATH_INFO: `/v3/projects/4d99f6a8a6134c79a3fb1901f870475e/users/e5f834b5be5048f8a858a47e9c94b9c8/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.372823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99f6a8a6134c79a3fb1901f870475e, user_id=e5f834b5be5048f8a858a47e9c94b9c8, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.376129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.465024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 950/1891] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:28 2022] PUT /identity/v3/projects/4d99f6a8a6134c79a3fb1901f870475e/users/e5f834b5be5048f8a858a47e9c94b9c8/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:28.471290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.479695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afdbbe-5221-414c-b378-726be4d123d0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.542699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daf9d5-c11a-4d51-914b-0eba9a0eb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.543406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf9d5-c11a-4d51-914b-0eba9a0eb731 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.543690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf9d5-c11a-4d51-914b-0eba9a0eb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.543993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daf9d5-c11a-4d51-914b-0eba9a0eb731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.544718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf9d5-c11a-4d51-914b-0eba9a0eb731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.546294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daf9d5-c11a-4d51-914b-0eba9a0eb731 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.556962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 942/1892] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:28.561117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.571511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb386-e88e-4d75-8cbe-59636b9adb6b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.576192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.577076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.577357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.577634 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] PATH_INFO: `/v3/projects/4d99f6a8a6134c79a3fb1901f870475e/users/e5f834b5be5048f8a858a47e9c94b9c8/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.580225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99f6a8a6134c79a3fb1901f870475e, user_id=e5f834b5be5048f8a858a47e9c94b9c8, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.583628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.596453 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 951/1893] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:28 2022] PUT /identity/v3/projects/4d99f6a8a6134c79a3fb1901f870475e/users/e5f834b5be5048f8a858a47e9c94b9c8/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:28.606865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.607106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.607390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.642042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] MFA Rules not processed for user `e5f834b5be5048f8a858a47e9c94b9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:28.643459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:28.716950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 943/1894] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:28.728347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.730039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:28.789768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637674b4-3aa1-4080-9729-03f932390b48 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.793446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.794085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.794413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.794680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.804055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.805479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:28.815710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 952/1895] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:28.897615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:28.899437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:28.968853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479453ae-a517-4b07-9afb-e0916937fc87 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:28.974002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:28.974924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:28.975207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:28.979949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] PATH_INFO: `/v3/users/31d0c7185ccf4d7ebdd8ae820ba2b48a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:28.979949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d0c7185ccf4d7ebdd8ae820ba2b48a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:28.979949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:29.002284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:29.019210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:29.020727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:29.032566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05e6b0-98dc-4f3d-856f-abe2a6695d59 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:29.036330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c083d-7209-42b1-afbf-69aa9f9bddf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:29.036970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c083d-7209-42b1-afbf-69aa9f9bddf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:29.037256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c083d-7209-42b1-afbf-69aa9f9bddf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:29.037533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c083d-7209-42b1-afbf-69aa9f9bddf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:29.094716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c083d-7209-42b1-afbf-69aa9f9bddf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:29.096515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c083d-7209-42b1-afbf-69aa9f9bddf4 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:29.105219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 953/1896] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:29.164852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d0c7185ccf4d7ebdd8ae820ba2b48a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:29.177707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d0c7185ccf4d7ebdd8ae820ba2b48a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:29.178411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d0c7185ccf4d7ebdd8ae820ba2b48a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:29.242199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d0c7185ccf4d7ebdd8ae820ba2b48a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:29.242813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d0c7185ccf4d7ebdd8ae820ba2b48a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:29.256481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 944/1897] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:28 2022] DELETE /identity/v3/users/31d0c7185ccf4d7ebdd8ae820ba2b48a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:29.261039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:29.261488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:29.261598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:29.280140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:29.281538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:29.321116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:29.340472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 954/1898] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:29.350140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:29.351907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:29.413278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45412934-964c-4a2f-a42d-c4b5130d460d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:29.416853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:29.417662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:29.417786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:29.418026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:29.435159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:29.435159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:29.441245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 945/1899] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:29.951728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:29.954138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:29.970467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a3515-3c39-48e1-bce0-d4d9f241a46e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:29.975234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:29.976247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:29.976421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:29.976734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] PATH_INFO: `/v3/projects/4c3c217e02f546a1919cc0ce1e868661` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:29.978122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3c217e02f546a1919cc0ce1e868661)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:29.980180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:29.995159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:29.996595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:30.010820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56bcb-919c-45ac-9182-e0acdb40a053 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:30.015987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:30.020013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:30.020013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:30.020013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] PATH_INFO: `/v3/users/db63be051a7b44d681dbcef20f7bbfa9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:30.020013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db63be051a7b44d681dbcef20f7bbfa9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:30.020586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:30.099465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3c217e02f546a1919cc0ce1e868661', 'request_id': 'req-c5c83e36-03fd-4919-bad5-48a40ab0f539'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.196024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3c217e02f546a1919cc0ce1e868661', 'request_id': 'req-c5c83e36-03fd-4919-bad5-48a40ab0f539'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.202867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3c217e02f546a1919cc0ce1e868661', 'request_id': 'req-c5c83e36-03fd-4919-bad5-48a40ab0f539'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.210946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db63be051a7b44d681dbcef20f7bbfa9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.213948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] The token cache is being invalidate because project 4c3c217e02f546a1919cc0ce1e868661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:30.214236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.214925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5c83e36-03fd-4919-bad5-48a40ab0f539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.216949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 955/1900] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:29 2022] DELETE /identity/v3/projects/4c3c217e02f546a1919cc0ce1e868661 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:30.231017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db63be051a7b44d681dbcef20f7bbfa9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.231768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db63be051a7b44d681dbcef20f7bbfa9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.333726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db63be051a7b44d681dbcef20f7bbfa9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.334452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db63be051a7b44d681dbcef20f7bbfa9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:30.349261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 946/1901] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:29 2022] DELETE /identity/v3/users/db63be051a7b44d681dbcef20f7bbfa9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:30.353830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:30.354334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:30.354518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:30.374730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:30.376696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:30.435752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 956/1902] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:30.446570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:30.448027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:30.463608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:30.508646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2783dc5-f500-4bbc-b392-72be0d213292 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:30.512584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:30.513242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:30.513528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:30.513804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:30.523645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:30.525218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:30.535717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 947/1903] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:30.952173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:30.957313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:30.984552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479ecf-3b87-4548-addb-d34a5c2c2972 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:30.990986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:30.991911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:30.995553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:30.995893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] PATH_INFO: `/v3/projects/c2217631eb7c42398a7ae6eab8e9621f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:30.998105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2217631eb7c42398a7ae6eab8e9621f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:31.000069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:31.150906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2217631eb7c42398a7ae6eab8e9621f', 'request_id': 'req-0f5e575a-4a7b-4e9c-9915-ba399b989d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.213136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2217631eb7c42398a7ae6eab8e9621f', 'request_id': 'req-0f5e575a-4a7b-4e9c-9915-ba399b989d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.220907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2217631eb7c42398a7ae6eab8e9621f', 'request_id': 'req-0f5e575a-4a7b-4e9c-9915-ba399b989d95'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.222893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:31.232069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] The token cache is being invalidate because project c2217631eb7c42398a7ae6eab8e9621f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:31.232449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.233160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.234818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 957/1904] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:30 2022] DELETE /identity/v3/projects/c2217631eb7c42398a7ae6eab8e9621f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:31.238974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:31.248749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37445b88-4dce-45dc-98d4-a47eb11ebdba service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:31.305933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:31.306802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:31.307086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:31.307359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] PATH_INFO: `/v3/users/b276e6a75293440e8b6a6ece4c7bb144` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:31.308551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b276e6a75293440e8b6a6ece4c7bb144)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:31.310505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:31.512832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b276e6a75293440e8b6a6ece4c7bb144'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.526678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b276e6a75293440e8b6a6ece4c7bb144'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.527368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b276e6a75293440e8b6a6ece4c7bb144'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.606309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b276e6a75293440e8b6a6ece4c7bb144'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.606993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b0b71eb-90bc-4d35-96e2-f0e2aab9fe28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b276e6a75293440e8b6a6ece4c7bb144'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:31.628587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 948/1905] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:31 2022] DELETE /identity/v3/users/b276e6a75293440e8b6a6ece4c7bb144 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:32.067179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.070718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:32.096012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e575a-4a7b-4e9c-9915-ba399b989d95 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.168475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.169457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.169827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.170180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] PATH_INFO: `/v3/projects/de00ae32408f431a9b063c5d2aa724e5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.171546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de00ae32408f431a9b063c5d2aa724e5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.174091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.264875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de00ae32408f431a9b063c5d2aa724e5', 'request_id': 'req-cb4e55db-c688-4752-9ea8-0113fe8da6d9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:32.304066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de00ae32408f431a9b063c5d2aa724e5', 'request_id': 'req-cb4e55db-c688-4752-9ea8-0113fe8da6d9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:32.310472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de00ae32408f431a9b063c5d2aa724e5', 'request_id': 'req-cb4e55db-c688-4752-9ea8-0113fe8da6d9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:32.321846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] The token cache is being invalidate because project de00ae32408f431a9b063c5d2aa724e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:32.322149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:32.322779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb4e55db-c688-4752-9ea8-0113fe8da6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:32.324544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 958/1906] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:32 2022] DELETE /identity/v3/projects/de00ae32408f431a9b063c5d2aa724e5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:32.333278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.333764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.333855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.352269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:32.353512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:32.383858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:32.412809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 949/1907] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:32.420669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815175f-9883-4e54-bb09-9273141f666c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.420979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815175f-9883-4e54-bb09-9273141f666c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.421254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815175f-9883-4e54-bb09-9273141f666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.441442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b815175f-9883-4e54-bb09-9273141f666c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:32.442716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b815175f-9883-4e54-bb09-9273141f666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:32.450757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 959/1908] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:32.455675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.465839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fd9fb-d952-4e3e-a6cb-a82f897ba243 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.470781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.471441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.471733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.472049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.472782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:32.473094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.474750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.487746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 950/1909] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:32.492032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815175f-9883-4e54-bb09-9273141f666c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.501227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815175f-9883-4e54-bb09-9273141f666c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.505980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.506620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.506901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.507176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.507889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.509833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.591277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 960/1910] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:32 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:32.596091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.605905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a23f2-2d78-44da-9080-c0226182206e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.661397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.662063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.662350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.662628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.663313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.665256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.745232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 951/1911] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:32 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:32.749219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.761207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08fe89-510b-4776-b5c9-811ce83b052e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.770546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.770546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.770546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.770546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.770903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.770903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.780766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 961/1912] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:32.784711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.794728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb688c-b97c-4620-be63-e0091defbfa2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.799519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c138d-6e57-4492-bc36-11ab02181990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.800221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c138d-6e57-4492-bc36-11ab02181990 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.800509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c138d-6e57-4492-bc36-11ab02181990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.800790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c138d-6e57-4492-bc36-11ab02181990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.801508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c138d-6e57-4492-bc36-11ab02181990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.803099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c138d-6e57-4492-bc36-11ab02181990 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.814158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 952/1913] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:32.818155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:32.828310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a6c1-0d0a-4d20-86b1-e2ee5153a1e8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:32.833941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:32.834863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.835152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.835438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] PATH_INFO: `/v3/projects/ef3c0da564094c758c82bc5764a03c5c/users/f5009d770a54410a8ff06f003b7b2558/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.852577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3c0da564094c758c82bc5764a03c5c, user_id=f5009d770a54410a8ff06f003b7b2558, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:32.855251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:32.938934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 962/1914] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:32 2022] PUT /identity/v3/projects/ef3c0da564094c758c82bc5764a03c5c/users/f5009d770a54410a8ff06f003b7b2558/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:32.950418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:32.950714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:32.950999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:32.978434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] MFA Rules not processed for user `f5009d770a54410a8ff06f003b7b2558`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:32.979644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:33.044033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 953/1915] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:33.049688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.073369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:33.120155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9166d9-fa0b-4f62-9ad9-7800f04cb9c0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.124920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.126701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.127216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.127732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.128469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.130412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.243853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 963/1916] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:33 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:33.247762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.260607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17440c2-d03e-459f-8b18-7f1e8c665ea2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.293643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:33.324731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.324731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.324922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.325130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.325899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.327843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.414404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 954/1917] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:33 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:33.418152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.429356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5063af9-2cb1-4fda-88eb-c9039c42cf49 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.434355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.435044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.435329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.435604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.436358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.437956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.449934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 964/1918] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:33.454260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.465610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f906f-26e1-41e0-8df0-1fa6d4d9c42b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.470445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.471328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.471614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.471931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] PATH_INFO: `/v3/projects/9da9e8a3e4c9483f82b3f1dc0eda6e2a/users/f59f4cf384d34515af11fe6133062cae/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.488031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da9e8a3e4c9483f82b3f1dc0eda6e2a, user_id=f59f4cf384d34515af11fe6133062cae, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.490844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.590579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 955/1919] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:33 2022] PUT /identity/v3/projects/9da9e8a3e4c9483f82b3f1dc0eda6e2a/users/f59f4cf384d34515af11fe6133062cae/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:33.595406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.605247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21622-e83c-4b1c-9b82-57ca12e45f32 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.662284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f968a-4063-4195-90cb-4107484de9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.662869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f968a-4063-4195-90cb-4107484de9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.663150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f968a-4063-4195-90cb-4107484de9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.663425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f968a-4063-4195-90cb-4107484de9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.664173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f968a-4063-4195-90cb-4107484de9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.665779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f968a-4063-4195-90cb-4107484de9a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.676224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 965/1920] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:33.680405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.690725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680a01-d1c7-4183-af25-69f17a76f1a2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.695791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.696772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.697053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.697332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] PATH_INFO: `/v3/projects/9da9e8a3e4c9483f82b3f1dc0eda6e2a/users/f59f4cf384d34515af11fe6133062cae/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.699392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da9e8a3e4c9483f82b3f1dc0eda6e2a, user_id=f59f4cf384d34515af11fe6133062cae, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.702086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.714733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 956/1921] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:33 2022] PUT /identity/v3/projects/9da9e8a3e4c9483f82b3f1dc0eda6e2a/users/f59f4cf384d34515af11fe6133062cae/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:33.725240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.725529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.725804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.753677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] MFA Rules not processed for user `f59f4cf384d34515af11fe6133062cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:33.754864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:33.819993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 966/1922] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:33.831422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.833383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:33.898077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25714-a878-4694-b86c-0bce545d70d3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:33.902510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445425f8-07ac-4a87-8971-c9436f5bceca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:33.903228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445425f8-07ac-4a87-8971-c9436f5bceca service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:33.903517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445425f8-07ac-4a87-8971-c9436f5bceca service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:33.903825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445425f8-07ac-4a87-8971-c9436f5bceca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:33.915730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445425f8-07ac-4a87-8971-c9436f5bceca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:33.917134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445425f8-07ac-4a87-8971-c9436f5bceca service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:33.926740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 957/1923] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:33.955851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:33.977595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:34.025783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb6db2-a91a-45c2-92e0-14c718226aa1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:34.030379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:34.031246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.031530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.031831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] PATH_INFO: `/v3/users/f5009d770a54410a8ff06f003b7b2558` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.033726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5009d770a54410a8ff06f003b7b2558)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:34.036523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:34.223248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5009d770a54410a8ff06f003b7b2558'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.234933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5009d770a54410a8ff06f003b7b2558'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.235777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5009d770a54410a8ff06f003b7b2558'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.236431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5009d770a54410a8ff06f003b7b2558'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.310254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5009d770a54410a8ff06f003b7b2558'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.323859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 967/1924] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:33 2022] DELETE /identity/v3/users/f5009d770a54410a8ff06f003b7b2558 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:34.328748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.329678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.330084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.348317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:34.349531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:34.407291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 958/1925] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:34.422109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:34.422552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:34.423006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:34.424357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:34.437221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0a894-64ba-49b4-ac9d-3c1b93efe046 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:34.446101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:34.447040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.447321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.447598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] PATH_INFO: `/v3/users/3496bba1ef1f4c3ca6cab2bbe77a4304` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.449573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3496bba1ef1f4c3ca6cab2bbe77a4304)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:34.451544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:34.477732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:34.503141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77617261-b646-480b-aa4e-4a49efe64308 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:34.506800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbf395-2599-4d98-89e6-b096e9f2d4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:34.507451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbf395-2599-4d98-89e6-b096e9f2d4ee service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.507732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbf395-2599-4d98-89e6-b096e9f2d4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.508031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbf395-2599-4d98-89e6-b096e9f2d4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.518576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbf395-2599-4d98-89e6-b096e9f2d4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:34.520218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbf395-2599-4d98-89e6-b096e9f2d4ee service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:34.530156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 968/1926] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:34.650709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3496bba1ef1f4c3ca6cab2bbe77a4304'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.663037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3496bba1ef1f4c3ca6cab2bbe77a4304'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.663722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3496bba1ef1f4c3ca6cab2bbe77a4304'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.727526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3496bba1ef1f4c3ca6cab2bbe77a4304'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.728610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3496bba1ef1f4c3ca6cab2bbe77a4304'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:34.742276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 959/1927] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:34 2022] DELETE /identity/v3/users/3496bba1ef1f4c3ca6cab2bbe77a4304 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:34.747917 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.752147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.752147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.775382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:34.776766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:34.812960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:34.847844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 969/1928] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:34.857400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:34.858964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:34.929674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fc757-8394-45f9-a328-8b5135b852cf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:34.933376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:34.934024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.934306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.934596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.943955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:34.945397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:34.952372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:34.953875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:34.964074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 960/1929] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:34.974495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe18a1-a338-49fa-94e5-18db5568e6bd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:34.979362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:34.980267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:34.980550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:34.980826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] PATH_INFO: `/v3/projects/ef3c0da564094c758c82bc5764a03c5c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:34.982240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3c0da564094c758c82bc5764a03c5c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:34.984313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:35.105062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3c0da564094c758c82bc5764a03c5c', 'request_id': 'req-844d8ec1-9bf5-457d-8569-a9c044d4ec28'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.196038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3c0da564094c758c82bc5764a03c5c', 'request_id': 'req-844d8ec1-9bf5-457d-8569-a9c044d4ec28'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.203033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3c0da564094c758c82bc5764a03c5c', 'request_id': 'req-844d8ec1-9bf5-457d-8569-a9c044d4ec28'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.214966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] The token cache is being invalidate because project ef3c0da564094c758c82bc5764a03c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:35.215268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.216049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.217737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 970/1930] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:34 2022] DELETE /identity/v3/projects/ef3c0da564094c758c82bc5764a03c5c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:35.224852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:35.241626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538fa40-7c57-4483-9aa5-46f025772e44 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:35.303969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:35.304852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:35.305137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:35.305415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] PATH_INFO: `/v3/users/f59f4cf384d34515af11fe6133062cae` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:35.306598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59f4cf384d34515af11fe6133062cae)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:35.308693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:35.356687 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:35.358467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:35.374432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8ec1-9bf5-457d-8569-a9c044d4ec28 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:35.380490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:35.381317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:35.381629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:35.381967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] PATH_INFO: `/v3/projects/e9305a7333df4c9b898b18aa185c536f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:35.383094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9305a7333df4c9b898b18aa185c536f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:35.384997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:35.617325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9305a7333df4c9b898b18aa185c536f', 'request_id': 'req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.632716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:35.636472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59f4cf384d34515af11fe6133062cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.652987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59f4cf384d34515af11fe6133062cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.652987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59f4cf384d34515af11fe6133062cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.700056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9305a7333df4c9b898b18aa185c536f', 'request_id': 'req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.709615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9305a7333df4c9b898b18aa185c536f', 'request_id': 'req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.721376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] The token cache is being invalidate because project e9305a7333df4c9b898b18aa185c536f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:35.721690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.722426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.724105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 971/1931] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:35 2022] DELETE /identity/v3/projects/e9305a7333df4c9b898b18aa185c536f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:35.727956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:35.729418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:35.778981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:35.798598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0e70-8d8f-4ea8-b74e-7b24b1e59dc4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:35.802253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59f4cf384d34515af11fe6133062cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.802989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59f4cf384d34515af11fe6133062cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:35.803709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:35.804637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:35.804923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:35.805191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] PATH_INFO: `/v3/users/e5f834b5be5048f8a858a47e9c94b9c8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:35.806362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f834b5be5048f8a858a47e9c94b9c8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:35.808355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:35.816060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 961/1932] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:35 2022] DELETE /identity/v3/users/f59f4cf384d34515af11fe6133062cae => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:36.045171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f834b5be5048f8a858a47e9c94b9c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.057882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f834b5be5048f8a858a47e9c94b9c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.061765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f834b5be5048f8a858a47e9c94b9c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.062664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f834b5be5048f8a858a47e9c94b9c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.144486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f834b5be5048f8a858a47e9c94b9c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.158437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 972/1933] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:35 2022] DELETE /identity/v3/users/e5f834b5be5048f8a858a47e9c94b9c8 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:36.273352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:36.275400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:36.387046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247865-39b4-4e4c-9300-62ff680ed91a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:36.442707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:36.443581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:36.443909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:36.444190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] PATH_INFO: `/v3/projects/9da9e8a3e4c9483f82b3f1dc0eda6e2a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:36.445386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da9e8a3e4c9483f82b3f1dc0eda6e2a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:36.447297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:36.650008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da9e8a3e4c9483f82b3f1dc0eda6e2a', 'request_id': 'req-256d0403-68da-41c4-a5af-4881a5ff8ab6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.656139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da9e8a3e4c9483f82b3f1dc0eda6e2a', 'request_id': 'req-256d0403-68da-41c4-a5af-4881a5ff8ab6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.662402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da9e8a3e4c9483f82b3f1dc0eda6e2a', 'request_id': 'req-256d0403-68da-41c4-a5af-4881a5ff8ab6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.689300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:36.690795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:36.707113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576969e5-1136-42a7-b07f-3f88a1e8dae4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:36.751916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:36.758611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] The token cache is being invalidate because project 9da9e8a3e4c9483f82b3f1dc0eda6e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:36.758986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.759727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-256d0403-68da-41c4-a5af-4881a5ff8ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:36.761795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 962/1934] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:36 2022] DELETE /identity/v3/projects/9da9e8a3e4c9483f82b3f1dc0eda6e2a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:36.766747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88647fd5-59a4-4503-865b-a80489d617fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:36.767234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88647fd5-59a4-4503-865b-a80489d617fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:36.767527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88647fd5-59a4-4503-865b-a80489d617fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:36.775082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:36.775997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:36.776282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:36.776617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] PATH_INFO: `/v3/projects/4d99f6a8a6134c79a3fb1901f870475e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:36.779710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d99f6a8a6134c79a3fb1901f870475e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:36.781823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:36.792712 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88647fd5-59a4-4503-865b-a80489d617fa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:36.793801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88647fd5-59a4-4503-865b-a80489d617fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:36.804647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 963/1935] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:36.813205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:36.813794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:36.814420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:36.834578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:36.836051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:36.844394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 964/1936] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:36.849109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:36.858291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d5b5a-16b4-46fa-b552-5fc914c87f37 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:36.863650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:36.864346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:36.864635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:36.864917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:36.865646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:36.865956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:36.867560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:36.882935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 965/1937] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:15:36.887281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:36.898676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80441fb5-3dfa-4d1a-ae45-182398660928 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:36.904017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:36.907181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:36.907181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:36.907181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:36.907181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:36.908016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:36.928384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d99f6a8a6134c79a3fb1901f870475e', 'request_id': 'req-173eaa60-b2a8-4069-aa6f-40104484651c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:37.006175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d99f6a8a6134c79a3fb1901f870475e', 'request_id': 'req-173eaa60-b2a8-4069-aa6f-40104484651c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:37.013222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d99f6a8a6134c79a3fb1901f870475e', 'request_id': 'req-173eaa60-b2a8-4069-aa6f-40104484651c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:37.017620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 966/1938] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:36 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:37.017764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:37.018791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.025199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] The token cache is being invalidate because project 4d99f6a8a6134c79a3fb1901f870475e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:37.025515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:37.026268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-173eaa60-b2a8-4069-aa6f-40104484651c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:37.027856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 973/1939] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:36 2022] DELETE /identity/v3/projects/4d99f6a8a6134c79a3fb1901f870475e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:37.033213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736202-c202-4324-b0f1-0a4392407fd1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.033583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736202-c202-4324-b0f1-0a4392407fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.033887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75736202-c202-4324-b0f1-0a4392407fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.051734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-75736202-c202-4324-b0f1-0a4392407fd1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:37.053064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75736202-c202-4324-b0f1-0a4392407fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:37.080361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c6c63-5bae-41cf-b7da-273f1018641e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.085552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.086455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.086852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.087139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.087861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.089789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.113680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 974/1940] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:37.122323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.122611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.122893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.140523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:37.142246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:37.150426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 975/1941] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:37.154460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.164048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44b9ea-45a2-4667-a9e7-dceee10a1f6a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.169243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 967/1942] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:37.169367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.169712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.169993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.170269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.170984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:37.171299 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.172201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.173339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.174212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:37.186277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7a1e5-68cc-4cfc-8cad-1ab57aa00fbe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.186426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 976/1943] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:15:37.190705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.191583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.192291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.192581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.192861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.193758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.195577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.203026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909d5e-0756-4676-9773-92245e6fae10 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.209015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.209733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.210011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.210290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.211101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.213183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 968/1944] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:37.213296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.213932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.228221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46514e-916e-462a-be1d-40a7e5eee727 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.233287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.234050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.234338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.234613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.235404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.237391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.248237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 969/1945] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:37.253201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.262704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6997e66-3ca2-4a58-85b3-cd9024bc437b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.267947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe103f-f9b4-4abe-8fa9-d1d5a926d7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.268826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe103f-f9b4-4abe-8fa9-d1d5a926d7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.269110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe103f-f9b4-4abe-8fa9-d1d5a926d7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.269384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe103f-f9b4-4abe-8fa9-d1d5a926d7c4 admin admin] PATH_INFO: `/v3/projects/5f3cf22c976b4074a4fde05119d7a444/users/3ca8a1cca28d48bc85e41585e95d8902/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.288469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe103f-f9b4-4abe-8fa9-d1d5a926d7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3cf22c976b4074a4fde05119d7a444, user_id=3ca8a1cca28d48bc85e41585e95d8902, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.288469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe103f-f9b4-4abe-8fa9-d1d5a926d7c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.311590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 977/1946] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:37.316306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.377004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774155-569d-4324-b8d1-f0d3c4569e69 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.381743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.382415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.382721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.382981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.383672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.385655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.400711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 970/1947] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:37 2022] PUT /identity/v3/projects/5f3cf22c976b4074a4fde05119d7a444/users/3ca8a1cca28d48bc85e41585e95d8902/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:37.412153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.412564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.412852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.440977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] MFA Rules not processed for user `3ca8a1cca28d48bc85e41585e95d8902`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:37.442552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:37.482789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 978/1948] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:37.486837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:37.487221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.497690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d945-a676-45c2-a853-f827a8b86e27 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.511556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 971/1949] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:37.516070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.566669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.567342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.567637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.567951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.568684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.570452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.580463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860184e-fb34-4e6a-9291-c723388e483b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.581193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 979/1950] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:37.585300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.585428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.585967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.586250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.586530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.587217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.589142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.597283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49887134-82e4-4fc2-b379-c8cb1699d455 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.602146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.602801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.603091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.603878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.604326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.605895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.616136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 980/1951] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:37.620175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.630737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e62d3-901e-45b7-bb6d-664c6fd98fde admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.635754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad89d4c-1d5e-4dbf-80f1-be3570837921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.636660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad89d4c-1d5e-4dbf-80f1-be3570837921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.636944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad89d4c-1d5e-4dbf-80f1-be3570837921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.637223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad89d4c-1d5e-4dbf-80f1-be3570837921 admin admin] PATH_INFO: `/v3/projects/7f5c7e71112c4a5399d15c5634ca6f43/users/454aa89a77174500a59b888bb388ba21/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.652966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad89d4c-1d5e-4dbf-80f1-be3570837921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5c7e71112c4a5399d15c5634ca6f43, user_id=454aa89a77174500a59b888bb388ba21, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.655223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad89d4c-1d5e-4dbf-80f1-be3570837921 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.699188 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 972/1952] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:37.703185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.746355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 981/1953] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:37 2022] PUT /identity/v3/projects/7f5c7e71112c4a5399d15c5634ca6f43/users/454aa89a77174500a59b888bb388ba21/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:37.748638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.748924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.749295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.775952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] MFA Rules not processed for user `454aa89a77174500a59b888bb388ba21`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:37.777324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:37.777785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479b92-9509-48b1-826d-9018cadfadaa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.839143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.839841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.840200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.840983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.841267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.843187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.844241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:37.850916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 982/1954] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:37.853234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.864881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a28e9-8941-42f4-aa96-dbee82b406ce None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.869448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.870099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.870377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.870652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.871394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.873328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.948254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 973/1955] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:37.949373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.959670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2734-77b2-423c-88eb-2d3a29a96358 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:37.964299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:37.964953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:37.965241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:37.965512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:37.966230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:37.967843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:37.978998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 974/1956] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:37.983083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 983/1957] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:37.988401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:37.990108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.005511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cbaf4-1928-49b2-b41a-a97f09648a6d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.005511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:38.061708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82e45-54da-4f14-b027-cb0d329544a1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.067575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.068405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.068952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.069493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.070640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.072042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.072949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.073069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.073385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.073772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.074572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.076312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.091430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 975/1958] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:38.092498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.102609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145a411-37cf-4ef8-a614-c302825d2283 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.107308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.108234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.108878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.109361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] PATH_INFO: `/v3/projects/910afca432bc42d2a553c8c1577af00d/users/15290aa9ad994c9c8fc06ad0e3a88962/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.127307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=910afca432bc42d2a553c8c1577af00d, user_id=15290aa9ad994c9c8fc06ad0e3a88962, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.130935 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.196959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 984/1959] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:37 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:38.200637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.210919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41937d6f-5a69-4779-9736-a17611e927ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.215549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa86f59-fbc9-4fbb-b92a-3181cc39b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.216216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa86f59-fbc9-4fbb-b92a-3181cc39b8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.216500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa86f59-fbc9-4fbb-b92a-3181cc39b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.216777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa86f59-fbc9-4fbb-b92a-3181cc39b8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.217503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa86f59-fbc9-4fbb-b92a-3181cc39b8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.219623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa86f59-fbc9-4fbb-b92a-3181cc39b8a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.225335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 976/1960] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:38 2022] PUT /identity/v3/projects/910afca432bc42d2a553c8c1577af00d/users/15290aa9ad994c9c8fc06ad0e3a88962/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:38.231232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 985/1961] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:38.235719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.244861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.245312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.245511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.273718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] MFA Rules not processed for user `15290aa9ad994c9c8fc06ad0e3a88962`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:38.274978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:38.305190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a8c28-98b5-403e-b6db-25b0675f84ad admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.306847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:38.310023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.310914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.311198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.311472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] PATH_INFO: `/v3/projects/715d174ef8bc4cebbd324bf798a3db10/users/9afe7aa442fe4494805e05bf689c32ec/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.332537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=715d174ef8bc4cebbd324bf798a3db10, user_id=9afe7aa442fe4494805e05bf689c32ec, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.335476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.342167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 986/1962] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:38.352495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.364817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcb8e-e82a-4d95-ad43-f2f7dc5e6aa6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.369405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.370045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.373406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.373406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.373406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.373406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.413944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 977/1963] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:38 2022] PUT /identity/v3/projects/715d174ef8bc4cebbd324bf798a3db10/users/9afe7aa442fe4494805e05bf689c32ec/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:38.417761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.444483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 987/1964] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:38 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:38.448942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.474564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:38.488187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e88c7b-fc21-408d-b414-d3c5b757bd4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.511523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3850c-ded2-4d6a-b551-7b0216e1f8fb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.516227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.517788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.518091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.518355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.519039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.521030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.545106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.545776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.546057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.546333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.547048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.549246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.558877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 978/1965] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:38.562997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.572945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef8a17-3d1d-4a1a-adc8-db7f262010a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.577540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30271bea-9641-4390-88ee-85d86636d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.578408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271bea-9641-4390-88ee-85d86636d995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.578689 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271bea-9641-4390-88ee-85d86636d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.579036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271bea-9641-4390-88ee-85d86636d995 admin admin] PATH_INFO: `/v3/projects/715d174ef8bc4cebbd324bf798a3db10/users/9afe7aa442fe4494805e05bf689c32ec/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.581261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30271bea-9641-4390-88ee-85d86636d995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715d174ef8bc4cebbd324bf798a3db10, user_id=9afe7aa442fe4494805e05bf689c32ec, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.583951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30271bea-9641-4390-88ee-85d86636d995 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.594023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 979/1966] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:38 2022] PUT /identity/v3/projects/715d174ef8bc4cebbd324bf798a3db10/users/9afe7aa442fe4494805e05bf689c32ec/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:38.604003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.604298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.605109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.633867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 988/1967] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:38 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:38.634054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] MFA Rules not processed for user `9afe7aa442fe4494805e05bf689c32ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:38.634054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:38.635163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.646516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241878b-bcb6-4c5f-bde5-20744d3c7f16 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.693680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:38.703390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 980/1968] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:38.710535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.711277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.711637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.712011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.712807 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.714534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.714922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.719921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:38.728623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 989/1969] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:38.729599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.742387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19233-38ff-4eb9-adde-ab5f23863b15 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.747551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.749802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.749802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.749802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] PATH_INFO: `/v3/projects/6838e4b539414f409b014a7e60b44e37/users/09341da2f44b44eb82ae9f00f81c6dad/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.764093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6838e4b539414f409b014a7e60b44e37, user_id=09341da2f44b44eb82ae9f00f81c6dad, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.766803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.778017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d937c-8fc9-483b-9731-bde8848fc0f7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.781598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.782768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.783047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.783319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.792169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.793620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.803446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 981/1970] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:38.854344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 990/1971] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:38 2022] PUT /identity/v3/projects/6838e4b539414f409b014a7e60b44e37/users/09341da2f44b44eb82ae9f00f81c6dad/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:38.862824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.873979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41723d3-4cd0-45cf-828a-b981a144e773 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.878511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:38.906123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.935240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.935942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.936226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.936500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.937223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.938845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.949451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 982/1972] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:38.953392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:38.963647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2fb72-04f0-42af-b299-bf903452381b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.963900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fb9f7-9149-44be-9d65-4ca68f52e237 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:38.967563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.968249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.968431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b909c-21da-4c61-8394-92301e2801d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:38.968554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.968800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.969293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b909c-21da-4c61-8394-92301e2801d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:38.970191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b909c-21da-4c61-8394-92301e2801d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:38.970475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b909c-21da-4c61-8394-92301e2801d6 admin admin] PATH_INFO: `/v3/projects/6838e4b539414f409b014a7e60b44e37/users/09341da2f44b44eb82ae9f00f81c6dad/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:38.974963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b909c-21da-4c61-8394-92301e2801d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6838e4b539414f409b014a7e60b44e37, user_id=09341da2f44b44eb82ae9f00f81c6dad, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:38.977766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b909c-21da-4c61-8394-92301e2801d6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:38.989489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 983/1973] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:38 2022] PUT /identity/v3/projects/6838e4b539414f409b014a7e60b44e37/users/09341da2f44b44eb82ae9f00f81c6dad/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:39.000554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:39.001402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:39.001682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:39.035035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] MFA Rules not processed for user `09341da2f44b44eb82ae9f00f81c6dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:39.036306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:39.043919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:39.045510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:39.056471 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 991/1974] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:39.112252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 984/1975] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:39.123113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:39.124706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:39.137647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9b1cf-750f-4652-8fe0-74c411252f21 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:39.211574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:39.212265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:39.212552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:39.212829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:39.222454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:39.224005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:39.233974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 992/1976] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:39.352441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:39.362527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41cc3c-6e96-4f23-9dc8-8a65cc302cb9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:39.366120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56727678-712c-450d-9ed4-f28da0b92b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:39.366757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56727678-712c-450d-9ed4-f28da0b92b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:39.367040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56727678-712c-450d-9ed4-f28da0b92b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:39.367315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56727678-712c-450d-9ed4-f28da0b92b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:39.422012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56727678-712c-450d-9ed4-f28da0b92b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:39.424064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56727678-712c-450d-9ed4-f28da0b92b3c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:39.432823 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 985/1977] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:43.294864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:43.311997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:43.360581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501c978-a730-402c-9f03-d6fd64056ae5 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:43.365957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:43.366825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:43.367107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:43.367442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] PATH_INFO: `/v3/users/454aa89a77174500a59b888bb388ba21` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:43.368587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454aa89a77174500a59b888bb388ba21)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:43.370580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:43.555883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454aa89a77174500a59b888bb388ba21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:43.567688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454aa89a77174500a59b888bb388ba21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:43.568408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454aa89a77174500a59b888bb388ba21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:43.569018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454aa89a77174500a59b888bb388ba21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:43.641581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454aa89a77174500a59b888bb388ba21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:43.655196 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 993/1978] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:43 2022] DELETE /identity/v3/users/454aa89a77174500a59b888bb388ba21 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:43.660907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:43.661387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:43.661504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:43.681732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:43.683267 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:43.693172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:43.755635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 986/1979] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:43.765909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:43.768564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:43.828876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a314c35-234f-4e80-9820-d7e813801415 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:43.833060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:43.833727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:43.834016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:43.834279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:43.848343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:43.850097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:43.862578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 994/1980] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:44.311422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:44.313246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:44.339400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762db16-ebb4-4c61-84fa-0eb4a98be515 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:44.345706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:44.345706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:44.345706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:44.345706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] PATH_INFO: `/v3/projects/7f5c7e71112c4a5399d15c5634ca6f43` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:44.347195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5c7e71112c4a5399d15c5634ca6f43)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:44.349448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:44.484090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5c7e71112c4a5399d15c5634ca6f43', 'request_id': 'req-1763ec30-90bb-473c-9f3c-ebddab2558a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.494616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5c7e71112c4a5399d15c5634ca6f43', 'request_id': 'req-1763ec30-90bb-473c-9f3c-ebddab2558a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.495515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:44.496977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:44.506481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5c7e71112c4a5399d15c5634ca6f43', 'request_id': 'req-1763ec30-90bb-473c-9f3c-ebddab2558a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.511761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fff5b9-a4bc-4dae-a50c-629ed6e77eec service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:44.550094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:44.575916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:44.576819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:44.577100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:44.577373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] PATH_INFO: `/v3/users/3ca8a1cca28d48bc85e41585e95d8902` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:44.578649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca8a1cca28d48bc85e41585e95d8902)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:44.580929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:44.607366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] The token cache is being invalidate because project 7f5c7e71112c4a5399d15c5634ca6f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:44.607585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.608299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.609874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 987/1981] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:44 2022] DELETE /identity/v3/projects/7f5c7e71112c4a5399d15c5634ca6f43 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:44.615005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:44.615672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:44.628819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763ec30-90bb-473c-9f3c-ebddab2558a3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:44.633443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:44.634302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:44.635637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:44.635637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] PATH_INFO: `/v3/users/9afe7aa442fe4494805e05bf689c32ec` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:44.636074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afe7aa442fe4494805e05bf689c32ec)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:44.637996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:44.793087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca8a1cca28d48bc85e41585e95d8902'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.805521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca8a1cca28d48bc85e41585e95d8902'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.806128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca8a1cca28d48bc85e41585e95d8902'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.806733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca8a1cca28d48bc85e41585e95d8902'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.826395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afe7aa442fe4494805e05bf689c32ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.838310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afe7aa442fe4494805e05bf689c32ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.838995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afe7aa442fe4494805e05bf689c32ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.915909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4b138fd1-4a90-481f-a74f-896bd34c2c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca8a1cca28d48bc85e41585e95d8902'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.929809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 995/1982] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:44 2022] DELETE /identity/v3/users/3ca8a1cca28d48bc85e41585e95d8902 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:44.934388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:44.934678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:44.934963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:44.954114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:44.955329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:44.978428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afe7aa442fe4494805e05bf689c32ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.979443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afe7aa442fe4494805e05bf689c32ec'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:44.993172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 988/1983] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:44 2022] DELETE /identity/v3/users/9afe7aa442fe4494805e05bf689c32ec => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:45.016851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 996/1984] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:45.023308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:45.024845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:45.036180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:45.086608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678b01-1fbb-468d-a345-b2d0b141452e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:45.091790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:45.092551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:45.092904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:45.093459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:45.162129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:45.163567 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:45.173209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 989/1985] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:45.494607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:45.496412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:45.522034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d853-82c6-4c4b-8ee0-1bd814728cd2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:45.529176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:45.530062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:45.530348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:45.530627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] PATH_INFO: `/v3/projects/715d174ef8bc4cebbd324bf798a3db10` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:45.532268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715d174ef8bc4cebbd324bf798a3db10)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:45.534772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:45.733244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:45.735089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:45.749573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d47ca7-f771-49c1-a389-cb0eae5fca73 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:45.752593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715d174ef8bc4cebbd324bf798a3db10', 'request_id': 'req-094da46a-2c2f-4180-8985-cd6ea68ad318'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.754538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:45.817207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:45.818119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:45.818404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:45.818685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] PATH_INFO: `/v3/projects/5f3cf22c976b4074a4fde05119d7a444` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:45.820012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3cf22c976b4074a4fde05119d7a444)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:45.822027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:45.841879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715d174ef8bc4cebbd324bf798a3db10', 'request_id': 'req-094da46a-2c2f-4180-8985-cd6ea68ad318'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.851361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715d174ef8bc4cebbd324bf798a3db10', 'request_id': 'req-094da46a-2c2f-4180-8985-cd6ea68ad318'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.865186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] The token cache is being invalidate because project 715d174ef8bc4cebbd324bf798a3db10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:45.865582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.866333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-094da46a-2c2f-4180-8985-cd6ea68ad318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.868028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 997/1986] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:45 2022] DELETE /identity/v3/projects/715d174ef8bc4cebbd324bf798a3db10 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:45.873079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a28e2f-912c-4068-a172-4e1a476cebcb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:45.873460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a28e2f-912c-4068-a172-4e1a476cebcb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:45.873745 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a28e2f-912c-4068-a172-4e1a476cebcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:45.894197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45a28e2f-912c-4068-a172-4e1a476cebcb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:45.895441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45a28e2f-912c-4068-a172-4e1a476cebcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:45.903676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 998/1987] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:45.912859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:45.913148 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:45.913426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:45.933716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:45.935138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:45.936855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3cf22c976b4074a4fde05119d7a444', 'request_id': 'req-ae75ab88-e425-4fba-b015-0dc61a3a3719'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.945991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3cf22c976b4074a4fde05119d7a444', 'request_id': 'req-ae75ab88-e425-4fba-b015-0dc61a3a3719'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.951752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:45.953474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3cf22c976b4074a4fde05119d7a444', 'request_id': 'req-ae75ab88-e425-4fba-b015-0dc61a3a3719'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:45.997150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 999/1988] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:46.001338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] The token cache is being invalidate because project 5f3cf22c976b4074a4fde05119d7a444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:46.001480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.002952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.002952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.007873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 990/1989] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:45 2022] DELETE /identity/v3/projects/5f3cf22c976b4074a4fde05119d7a444 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:46.011203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.012175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58e44-dafc-43df-836e-b3a8ef886dcc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.012810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.017413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.018874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.019167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.019448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.020229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:46.020537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.022264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.028644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75ab88-e425-4fba-b015-0dc61a3a3719 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.034484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.035372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.035698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.035983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] PATH_INFO: `/v3/users/15290aa9ad994c9c8fc06ad0e3a88962` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.037315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15290aa9ad994c9c8fc06ad0e3a88962)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.039352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.041225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1000/1990] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:15:46.042231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.044163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.058593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e595-c2ab-423d-af7d-19f8811c0985 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.065992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.065992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.065992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.065992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.066350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.068103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.177108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1001/1991] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:46 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:46.179641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.211363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15290aa9ad994c9c8fc06ad0e3a88962'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.231548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15290aa9ad994c9c8fc06ad0e3a88962'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.233944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15290aa9ad994c9c8fc06ad0e3a88962'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.262749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a90b8-40ef-4f5f-bcc8-40b772bbf576 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.268435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.269195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.269468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.269753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.270455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.272405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.293044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15290aa9ad994c9c8fc06ad0e3a88962'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.293760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15290aa9ad994c9c8fc06ad0e3a88962'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.311978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 991/1992] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:46 2022] DELETE /identity/v3/users/15290aa9ad994c9c8fc06ad0e3a88962 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:46.360831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.361765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1002/1993] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:46 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:46.362667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.439545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.446000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.464271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058de47-432b-47b0-8a8d-fa0339721884 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.469437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.470448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.471454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.471827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] PATH_INFO: `/v3/users/2c94b835e06445b0ab849c53b5cb67cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.473078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c94b835e06445b0ab849c53b5cb67cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.475007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.476865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf525b1-2c90-4964-8593-c520fa4b4d72 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.482465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.483143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.483429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.483747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.484532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.486232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.496865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 992/1994] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:46.500716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.503102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=5,keystone:DELETE=6,keystone:SELECT=89 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:46.511929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87bc2-8fc1-433e-940f-cfa9239842b3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.516735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.517431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.518390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.518668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.519407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.521044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.531331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 993/1995] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:46.535629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.547932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d2478-6155-4d1b-8197-51ec64fe5158 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.553551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c1a8c-b8cc-4a8d-ae35-78fa0040c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.554451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1a8c-b8cc-4a8d-ae35-78fa0040c982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.558026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1a8c-b8cc-4a8d-ae35-78fa0040c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.558026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c1a8c-b8cc-4a8d-ae35-78fa0040c982 admin admin] PATH_INFO: `/v3/projects/937ffebd1a9945588cfe02e2310a16d4/users/029d9b8a8e45449884d422288623d40a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.572734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1a8c-b8cc-4a8d-ae35-78fa0040c982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937ffebd1a9945588cfe02e2310a16d4, user_id=029d9b8a8e45449884d422288623d40a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.575979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c1a8c-b8cc-4a8d-ae35-78fa0040c982 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.661295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c94b835e06445b0ab849c53b5cb67cf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.674368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c94b835e06445b0ab849c53b5cb67cf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.675093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c94b835e06445b0ab849c53b5cb67cf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.675712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c94b835e06445b0ab849c53b5cb67cf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.683192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 994/1996] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:46 2022] PUT /identity/v3/projects/937ffebd1a9945588cfe02e2310a16d4/users/029d9b8a8e45449884d422288623d40a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:46.687040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ed4d-674e-44d0-8103-63d022f0a6c7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.687330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ed4d-674e-44d0-8103-63d022f0a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.687607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7ed4d-674e-44d0-8103-63d022f0a6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.714280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dad7ed4d-674e-44d0-8103-63d022f0a6c7 None None] MFA Rules not processed for user `029d9b8a8e45449884d422288623d40a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:46.715464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dad7ed4d-674e-44d0-8103-63d022f0a6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.724609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:46.757175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c94b835e06445b0ab849c53b5cb67cf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.773377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1003/1997] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:46 2022] DELETE /identity/v3/users/2c94b835e06445b0ab849c53b5cb67cf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:46.774098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.775684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.781448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 995/1998] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:46.782939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.783279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.783551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.803420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:46.804880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.846799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa4934-2372-4231-8238-657d97b798ec admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.851446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.852343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.852613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.852888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] PATH_INFO: `/v3/projects/910afca432bc42d2a553c8c1577af00d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.854073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=910afca432bc42d2a553c8c1577af00d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.856016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:46.863297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 996/1999] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:46.864051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:46.865328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:46.928814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065b9c6-12fd-465b-adba-16479f987e77 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:46.932423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:46.933068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:46.933353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:46.933628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:46.972791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910afca432bc42d2a553c8c1577af00d', 'request_id': 'req-30f52b66-25f6-4208-ae7e-e1740448e37d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:46.993579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:46.995040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:47.006428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 997/2000] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:47.007260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:47.008672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:47.058977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910afca432bc42d2a553c8c1577af00d', 'request_id': 'req-30f52b66-25f6-4208-ae7e-e1740448e37d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.068185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910afca432bc42d2a553c8c1577af00d', 'request_id': 'req-30f52b66-25f6-4208-ae7e-e1740448e37d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.068447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ce2b-d917-4247-b766-0e9f9ef5d90a service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:47.080427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] The token cache is being invalidate because project 910afca432bc42d2a553c8c1577af00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:47.080724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.081760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.083621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1004/2001] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:46 2022] DELETE /identity/v3/projects/910afca432bc42d2a553c8c1577af00d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:47.087548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:47.089867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:47.094674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:47.125813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:47.126480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:47.126766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:47.127081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:47.128975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:47.132557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:47.173337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f52b66-25f6-4208-ae7e-e1740448e37d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:47.178731 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:47.180000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:47.180460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:47.180750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] PATH_INFO: `/v3/users/09341da2f44b44eb82ae9f00f81c6dad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:47.182188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09341da2f44b44eb82ae9f00f81c6dad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:47.184356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:47.210791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:47.212417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:47.223658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 998/2002] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:47.366399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09341da2f44b44eb82ae9f00f81c6dad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.381381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09341da2f44b44eb82ae9f00f81c6dad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.382171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09341da2f44b44eb82ae9f00f81c6dad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.382783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09341da2f44b44eb82ae9f00f81c6dad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.477181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09341da2f44b44eb82ae9f00f81c6dad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.501013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1005/2003] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:47 2022] DELETE /identity/v3/users/09341da2f44b44eb82ae9f00f81c6dad => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:47.715043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:47.716785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:47.731549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0096fce-b24a-4ccf-88f3-d23f038359c1 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:47.823119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:47.832540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:47.832540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:47.832540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] PATH_INFO: `/v3/projects/06a80bd3135e4161a4fcfd2e73e6f838` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:47.832540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a80bd3135e4161a4fcfd2e73e6f838)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:47.832540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:47.850651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:47.936818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a80bd3135e4161a4fcfd2e73e6f838', 'request_id': 'req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.943832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a80bd3135e4161a4fcfd2e73e6f838', 'request_id': 'req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:47.949414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a80bd3135e4161a4fcfd2e73e6f838', 'request_id': 'req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.004954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] The token cache is being invalidate because project 06a80bd3135e4161a4fcfd2e73e6f838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:48.006671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.006671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.010318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 999/2004] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:47 2022] DELETE /identity/v3/projects/06a80bd3135e4161a4fcfd2e73e6f838 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:48.012387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:48.014109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.029868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf8ca-8043-45a1-8802-bbe7469bd89d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:48.106693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:48.107672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.108183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.108409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] PATH_INFO: `/v3/users/b601b9dc03354237bb5ceff285b572a4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.109732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b601b9dc03354237bb5ceff285b572a4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:48.112503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:48.178793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:48.180254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.194663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d9c2-b6d6-4c8e-b3b6-e6157e88f637 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:48.199698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:48.200618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.200904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.201212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] PATH_INFO: `/v3/projects/6838e4b539414f409b014a7e60b44e37` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.202526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6838e4b539414f409b014a7e60b44e37)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:48.204587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:48.370779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b601b9dc03354237bb5ceff285b572a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.373036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:48.375845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6838e4b539414f409b014a7e60b44e37', 'request_id': 'req-b631ce8b-6b2f-4930-a2bf-257c1b25b392'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.383961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6838e4b539414f409b014a7e60b44e37', 'request_id': 'req-b631ce8b-6b2f-4930-a2bf-257c1b25b392'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.389010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b601b9dc03354237bb5ceff285b572a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.389988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b601b9dc03354237bb5ceff285b572a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.390609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6838e4b539414f409b014a7e60b44e37', 'request_id': 'req-b631ce8b-6b2f-4930-a2bf-257c1b25b392'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.390722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b601b9dc03354237bb5ceff285b572a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.481993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7060e14a-9a72-42e9-bc3d-c5a8b13de91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b601b9dc03354237bb5ceff285b572a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.495435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1006/2005] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:48 2022] DELETE /identity/v3/users/b601b9dc03354237bb5ceff285b572a4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:48.498384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000d9ba-9ee0-4296-8de3-bf05d4aa6565 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.498384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000d9ba-9ee0-4296-8de3-bf05d4aa6565 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.498384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000d9ba-9ee0-4296-8de3-bf05d4aa6565 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.498662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1007/2006] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:15:48.511184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.515240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.515240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.530365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:48.531643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.558397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] The token cache is being invalidate because project 6838e4b539414f409b014a7e60b44e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:48.558705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.559347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b631ce8b-6b2f-4930-a2bf-257c1b25b392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:48.561135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1000/2007] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:48 2022] DELETE /identity/v3/projects/6838e4b539414f409b014a7e60b44e37 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:48.567404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6abb-a22b-45ed-a506-592d787f44cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.567698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6abb-a22b-45ed-a506-592d787f44cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.568007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba6abb-a22b-45ed-a506-592d787f44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.595253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6eba6abb-a22b-45ed-a506-592d787f44cf None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:48.598214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6eba6abb-a22b-45ed-a506-592d787f44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.608335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1008/2008] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:48.621015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:48.622416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.638164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645b407-91b1-4644-bb59-e3a55f52b310 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:48.644475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:48.645139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.645518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.645832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.655873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:48.657523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:48.670537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1009/2009] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:48.671098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:48.673209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.700276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1001/2010] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:48.710208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.712332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.712332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.732614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:48.733896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:48.757473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1002/2011] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:48.761813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:48.775317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c144-0d47-4e34-a137-416d1117d2b3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:48.782542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:48.783680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.784064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.784381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.785168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:48.785477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:48.787074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:48.790544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d6ab-2012-46b0-a4a0-2406ce84166a service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:48.796255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:48.797275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.797633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.797989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] PATH_INFO: `/v3/users/663b8de7a75342e28e9d2061efad8305` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.800574 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=663b8de7a75342e28e9d2061efad8305)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:48.801329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1003/2012] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:48.802717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:48.805937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:48.817258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b2a0-cb04-4a62-b129-3e9d2c5cbf2e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:48.823308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:48.824097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:48.824574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:48.825041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:48.825917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:48.828118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:48.834706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:48.984202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1004/2013] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:48 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:48.985450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.018639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663b8de7a75342e28e9d2061efad8305'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.031000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663b8de7a75342e28e9d2061efad8305'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.031842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663b8de7a75342e28e9d2061efad8305'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.032803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663b8de7a75342e28e9d2061efad8305'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.052704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867144b-ea85-4932-90ea-787f11db0064 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.057715 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.058383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.058664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.058939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.059634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.061588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.127993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663b8de7a75342e28e9d2061efad8305'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.146322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1010/2014] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:48 2022] DELETE /identity/v3/users/663b8de7a75342e28e9d2061efad8305 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:49.146322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.146598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1005/2015] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:48 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:49.149665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.152893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.154697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.175361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a3cd7-561d-47fc-b368-bdac99260ba8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.227693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a6ccc-c435-4b92-96d3-26f4a702ea1a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.239913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.241088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.241550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.241832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] PATH_INFO: `/v3/projects/26588f0f471845c0b4d333fbf084e242` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.243134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26588f0f471845c0b4d333fbf084e242)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.245061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.251278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.253120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.253686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.254122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.254858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.256645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.269250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1006/2016] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:49.273091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.284424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53caa-4720-49fb-b213-6c7f7bf93570 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.290956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.291693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.292025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.292314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.293215 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.294699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.305552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1007/2017] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:49.310228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.321023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a343c8-ecef-46ed-a2a1-4a5d70ebebd4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.325950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.326797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.327062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.327359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] PATH_INFO: `/v3/projects/6cd58c1c95c54abc92b3082af7be9bab/users/65af5974951c4ea99de9f72bc2246005/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.343701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd58c1c95c54abc92b3082af7be9bab, user_id=65af5974951c4ea99de9f72bc2246005, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.346827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.350511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:49.357118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26588f0f471845c0b4d333fbf084e242', 'request_id': 'req-15ca3e8e-b943-42f1-9eae-d0baac462c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.419390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26588f0f471845c0b4d333fbf084e242', 'request_id': 'req-15ca3e8e-b943-42f1-9eae-d0baac462c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.426704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26588f0f471845c0b4d333fbf084e242', 'request_id': 'req-15ca3e8e-b943-42f1-9eae-d0baac462c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.428607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1008/2018] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:49 2022] PUT /identity/v3/projects/6cd58c1c95c54abc92b3082af7be9bab/users/65af5974951c4ea99de9f72bc2246005/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:49.439228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.441602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.449326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] The token cache is being invalidate because project 26588f0f471845c0b4d333fbf084e242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:49.449746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.450565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ca3e8e-b943-42f1-9eae-d0baac462c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.452456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1011/2019] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:49 2022] DELETE /identity/v3/projects/26588f0f471845c0b4d333fbf084e242 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:49.453906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6893-dd45-4084-b156-5cba357b2477 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.454199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6893-dd45-4084-b156-5cba357b2477 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.454477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6893-dd45-4084-b156-5cba357b2477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.483170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f68c6893-dd45-4084-b156-5cba357b2477 None None] MFA Rules not processed for user `65af5974951c4ea99de9f72bc2246005`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:49.484549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f68c6893-dd45-4084-b156-5cba357b2477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.513455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a804438-8702-4e0c-b9d0-ffe41e900fc4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.519386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.520291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.520664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.520850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] PATH_INFO: `/v3/projects/1aeb238c6f4b4c67b876c966b62d3e86` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.522060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aeb238c6f4b4c67b876c966b62d3e86)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.524038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.556438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1012/2020] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:49.557755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.558047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.558332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.577975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:49.579168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.593846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1013/2021] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:49.593846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.596566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.652118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:49.654433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ff74c-c148-4ba2-90a5-b8c3aa049852 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.658528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aeb238c6f4b4c67b876c966b62d3e86', 'request_id': 'req-510f0ee4-b77a-435f-a7d2-b203693f0e1a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.665603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aeb238c6f4b4c67b876c966b62d3e86', 'request_id': 'req-510f0ee4-b77a-435f-a7d2-b203693f0e1a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.671131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aeb238c6f4b4c67b876c966b62d3e86', 'request_id': 'req-510f0ee4-b77a-435f-a7d2-b203693f0e1a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.704469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97465-86d4-4192-81b8-b755afd6928d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.705466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97465-86d4-4192-81b8-b755afd6928d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.705757 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97465-86d4-4192-81b8-b755afd6928d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.706287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97465-86d4-4192-81b8-b755afd6928d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.765474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97465-86d4-4192-81b8-b755afd6928d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.766906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] The token cache is being invalidate because project 1aeb238c6f4b4c67b876c966b62d3e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:49.767052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97465-86d4-4192-81b8-b755afd6928d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.767206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.767913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-510f0ee4-b77a-435f-a7d2-b203693f0e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:49.769525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1009/2022] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:49 2022] DELETE /identity/v3/projects/1aeb238c6f4b4c67b876c966b62d3e86 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:49.771005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.771300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.771584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.777520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1014/2023] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:49.778885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf792-4013-47cb-bd22-dbcfd53a15ce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.779591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf792-4013-47cb-bd22-dbcfd53a15ce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.779817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cf792-4013-47cb-bd22-dbcfd53a15ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.791527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:49.792774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.798496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6e7cf792-4013-47cb-bd22-dbcfd53a15ce None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:49.800356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6e7cf792-4013-47cb-bd22-dbcfd53a15ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.865129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1010/2024] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:49.868005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1015/2025] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:49.869632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.878601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.878895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.879175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.881969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e160-0e82-43a0-8aa5-c6e2cee19d14 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.887433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.888137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.888424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.888701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.888857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:49.889604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:49.889939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.892420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.913269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1011/2026] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:49.913725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:49.914309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.915506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:49.924359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1016/2027] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:49.926326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affb162-7b6b-42eb-b98c-5c9565bcc408 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.928595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.931232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.931918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.932209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.932489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.933345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.935252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.937665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60629954-569c-4420-a3fe-f47e6a770fbe None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.943049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.950076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.950076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.950076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.950076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:49.950076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.950076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:49.960391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1017/2028] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:15:49.964338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:49.975048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87658f2-afe7-4757-9413-3e18d31ad4ae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:49.980319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:49.980980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:49.981285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:49.981590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:49.982287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:49.984750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.015835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1012/2029] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:50.019269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.053979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:50.079008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1018/2030] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:49 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:50.079008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.091160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c6d30-e5ef-41cb-a2a1-817830ba143d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.160439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33086e72-6cd7-4d2e-973c-fff8f43f2619 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.166171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.167080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.167231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.167397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.168181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.169997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.184147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.184892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.185180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.185505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.186200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.188170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.207636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:50.258903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1019/2031] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:50 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:50.262913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.272949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7de418-0acc-4f41-be98-acf720dc926e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.278054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.278735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.279046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.279318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.280075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.281681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.292357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1020/2032] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:50.296120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.305819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ffc88-e9c0-4b8b-b47c-c57ac76724a3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.311069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.311716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.312033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.312310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.313006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.314654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.327147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1013/2033] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:50 2022] POST /identity/v3/users => generated 282 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:50.327348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1021/2034] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:50.330443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.332921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.342396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233b23-ae64-4053-95a9-c1902463deb7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.344126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07440f4-0d2e-434e-8274-881d0bd97b0a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.348189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.348854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.349136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.349410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.350124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.350980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949bee6-02cd-4e3c-b8b6-564d84f0ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.351719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.351906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949bee6-02cd-4e3c-b8b6-564d84f0ad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.352180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949bee6-02cd-4e3c-b8b6-564d84f0ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.352460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949bee6-02cd-4e3c-b8b6-564d84f0ad74 admin admin] PATH_INFO: `/v3/projects/a7fb5f2c32174d5082735110fdf8e8c4/users/379758250b684531bc0bcc3ba3055321/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.363437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1022/2035] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:50.365811 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.368544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949bee6-02cd-4e3c-b8b6-564d84f0ad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fb5f2c32174d5082735110fdf8e8c4, user_id=379758250b684531bc0bcc3ba3055321, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.371229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949bee6-02cd-4e3c-b8b6-564d84f0ad74 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.375636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c3f42-70d4-4594-b7e7-f6a9c13e5a80 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.380675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.381331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.381612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.381885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.382604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.384231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.398796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1023/2036] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:50.402934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.414153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caec77-fa46-40ec-9e0c-0a5cc4f6f0df admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.418952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a592af3-1806-4ff3-97b3-7ec027ec6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.419875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592af3-1806-4ff3-97b3-7ec027ec6ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.420163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592af3-1806-4ff3-97b3-7ec027ec6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.420603 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a592af3-1806-4ff3-97b3-7ec027ec6ea9 admin admin] PATH_INFO: `/v3/projects/589eef3655ea40bab8dc7d5e02a41bd7/users/ee54b7ce99db4a46b635a9e219f5772b/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.435853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a592af3-1806-4ff3-97b3-7ec027ec6ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589eef3655ea40bab8dc7d5e02a41bd7, user_id=ee54b7ce99db4a46b635a9e219f5772b, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.438594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a592af3-1806-4ff3-97b3-7ec027ec6ea9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.527338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1014/2037] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:50 2022] PUT /identity/v3/projects/a7fb5f2c32174d5082735110fdf8e8c4/users/379758250b684531bc0bcc3ba3055321/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:50.648405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.648405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.648405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.666457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] MFA Rules not processed for user `379758250b684531bc0bcc3ba3055321`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:50.667718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:50.738660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1015/2038] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:50.745439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1024/2039] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:50 2022] PUT /identity/v3/projects/589eef3655ea40bab8dc7d5e02a41bd7/users/ee54b7ce99db4a46b635a9e219f5772b/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:50.749730 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.751120 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:50.757022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.757325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.757608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.790960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] MFA Rules not processed for user `ee54b7ce99db4a46b635a9e219f5772b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:50.793276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:50.815696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:50.836334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708052ac-96b9-4db5-b925-6f1ee7030fca None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.843160 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:50.865308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1025/2040] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:50.869790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:50.903931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.904565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.904852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.905129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.933322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5c16b-d0bd-48e7-bcdd-a05da51c0466 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:50.938257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:50.938948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:50.939747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:50.940033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:50.940725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.942661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.963570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:50.965219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:50.975021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1016/2041] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:51.074565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1026/2042] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:50 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:15:51.078169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.089536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a725d7-8b07-44db-bbc7-129cffa96bca service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.148031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.148814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.148985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.149388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.149968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.152859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.180498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.191084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb8b3-e4ad-40de-ac78-99064993dee6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.197065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.197065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.197065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.197332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] PATH_INFO: `/v3/users/379758250b684531bc0bcc3ba3055321` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.198440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379758250b684531bc0bcc3ba3055321)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.200541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.237305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1017/2043] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:51 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:51.245760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.255586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633022b-5a5d-4b1f-a46d-dbafc63ee83d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.260472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.261132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.261419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.261696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.262429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.264064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.274859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1018/2044] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:51.278829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.288711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6cb6c-7e77-4647-9a36-5baa63ec312a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.293613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:51.294981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.295950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.296240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.296522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] PATH_INFO: `/v3/projects/e8f3883d57a946e59bc945c2173c5a33/users/7011bd90ec5b44499210ad2432b4c8cb/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.312459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f3883d57a946e59bc945c2173c5a33, user_id=7011bd90ec5b44499210ad2432b4c8cb, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.315700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.352289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379758250b684531bc0bcc3ba3055321'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:51.364578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379758250b684531bc0bcc3ba3055321'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:51.373887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379758250b684531bc0bcc3ba3055321'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:51.373887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379758250b684531bc0bcc3ba3055321'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:51.395918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1019/2045] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:51 2022] PUT /identity/v3/projects/e8f3883d57a946e59bc945c2173c5a33/users/7011bd90ec5b44499210ad2432b4c8cb/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:51.399734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.401425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:51.449288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fdf259a-7cf8-479b-8cfb-03d71fe3c1d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379758250b684531bc0bcc3ba3055321'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:51.463012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1027/2046] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:51 2022] DELETE /identity/v3/users/379758250b684531bc0bcc3ba3055321 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:51.467838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.468142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.468430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.469543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa29f-23c0-4eb1-87ce-7f2c166df3d8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.488514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:51.490118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:51.503217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:51.531628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.532347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.532633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.532914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.534455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.536108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.546179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1020/2047] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:51.550911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.554451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1028/2048] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:51.560844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625895-4e64-4f55-8621-015e1d0e1754 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.565817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2bc77-daf8-4652-9fe7-6ed1e613a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.566991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2bc77-daf8-4652-9fe7-6ed1e613a5df admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.567354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2bc77-daf8-4652-9fe7-6ed1e613a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.567643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2bc77-daf8-4652-9fe7-6ed1e613a5df admin admin] PATH_INFO: `/v3/projects/e8f3883d57a946e59bc945c2173c5a33/users/7011bd90ec5b44499210ad2432b4c8cb/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.568659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.569845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2bc77-daf8-4652-9fe7-6ed1e613a5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f3883d57a946e59bc945c2173c5a33, user_id=7011bd90ec5b44499210ad2432b4c8cb, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.570483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:51.572754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2bc77-daf8-4652-9fe7-6ed1e613a5df admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.587909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1021/2049] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:51 2022] PUT /identity/v3/projects/e8f3883d57a946e59bc945c2173c5a33/users/7011bd90ec5b44499210ad2432b4c8cb/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:51.598698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.598698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.598698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.632891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] MFA Rules not processed for user `7011bd90ec5b44499210ad2432b4c8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:51.635072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:51.666413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4167c5-94c1-4ca2-a899-e60c6593396b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.687711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:51.718411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.718984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1022/2050] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:51.719140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.719316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.719587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.733125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:51.735845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:51.791484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.793065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.796386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249c241-3193-467c-9ef0-576aa6b01ef6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:51.801198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:51.801882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:51.802166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:51.802442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:51.803335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1029/2051] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:51.813200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:51.815623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:51.830856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1023/2052] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:15:52.079825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.091663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a163713-d43a-4aad-a767-53ff59049c4a service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.103545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.103545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.103545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.103545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.104121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:52.134011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:52.168467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.169902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e78788-9cbf-430a-b894-62a128a7d864 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:52.178874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1030/2053] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:52.230551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.232125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:52.250014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b1d73-0c4a-48e1-8dcf-910406329e4f service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.255459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.259105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.260840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.261132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] PATH_INFO: `/v3/projects/a7fb5f2c32174d5082735110fdf8e8c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.262387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fb5f2c32174d5082735110fdf8e8c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.264460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:52.406877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fb5f2c32174d5082735110fdf8e8c4', 'request_id': 'req-801b4855-a520-4072-b894-f8cc9a221a8d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:52.414039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fb5f2c32174d5082735110fdf8e8c4', 'request_id': 'req-801b4855-a520-4072-b894-f8cc9a221a8d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:52.419757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fb5f2c32174d5082735110fdf8e8c4', 'request_id': 'req-801b4855-a520-4072-b894-f8cc9a221a8d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:52.492321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] The token cache is being invalidate because project a7fb5f2c32174d5082735110fdf8e8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:52.492321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:52.492321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-801b4855-a520-4072-b894-f8cc9a221a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:52.492321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1024/2054] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:52 2022] DELETE /identity/v3/projects/a7fb5f2c32174d5082735110fdf8e8c4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:52.500749 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.501273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.501383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.520631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:52.521821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:52.596604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1031/2055] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:52.604975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.605270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.605622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.624941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:52.630728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:52.634005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1025/2056] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:52.638184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.649231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b2d0-cb3d-400e-b2f1-cc51b3088c5a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.653795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.654446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.654726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.655002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.655881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:15:52.656188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.657802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:52.670684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1032/2057] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:15:52.675012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.684269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387840-6a53-45f0-b557-8a44ac2e7620 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.689073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.689717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.689997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.690273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.690994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.692968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:52.776184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1026/2058] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:52 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:52.780301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.791246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08f7be-00dc-4597-ae48-229cd457b36a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.848708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.849380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.849664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.849946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.850675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.852627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:52.937503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1033/2059] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:52 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:52.942008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.952583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a234d3-40dd-46f2-8d45-7b1542224667 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.958233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.958884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.959166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.959443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.960230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.961917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:52.972268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1027/2060] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:52.976026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:52.985848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ada7-9b4b-437a-b78c-e9d57858ff23 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:52.990489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa4a7c-e22b-4643-b07f-d7f459e8c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:52.991136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa4a7c-e22b-4643-b07f-d7f459e8c140 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:52.991418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa4a7c-e22b-4643-b07f-d7f459e8c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:52.991692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa4a7c-e22b-4643-b07f-d7f459e8c140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:52.992446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa4a7c-e22b-4643-b07f-d7f459e8c140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:52.994029 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa4a7c-e22b-4643-b07f-d7f459e8c140 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.004470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1034/2061] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:53.008308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.017965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021a3d-6dca-4568-9ed0-b933b8f88cca admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.023040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.023931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.024211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.024485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] PATH_INFO: `/v3/projects/63ab6a2be0d14eebad98a79239cab28d/users/8805cf96fc1b417e964f50883c7f88cc/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.038809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ab6a2be0d14eebad98a79239cab28d, user_id=8805cf96fc1b417e964f50883c7f88cc, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.041398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.104297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:53.109567 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1028/2062] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:53 2022] PUT /identity/v3/projects/63ab6a2be0d14eebad98a79239cab28d/users/8805cf96fc1b417e964f50883c7f88cc/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:53.119791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.120111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.120411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.148412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] MFA Rules not processed for user `8805cf96fc1b417e964f50883c7f88cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:53.149643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:53.168658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:53.213742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1035/2063] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:53.217804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.277525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76282c9f-155f-4982-af3f-d33e8d7e8259 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.282151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.282803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.283086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.283362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.284086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.286131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.374050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1029/2064] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:53 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:53.378081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.388659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf90a4-f8d3-4fd1-991f-8568f18ae1ac None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.444491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.445164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.445467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.445718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.446544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.448492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.542137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1036/2065] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:53 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:53.543357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.553894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ab42-6131-43fb-a7d0-4f1141be3ba8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.558501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.559161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.559443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.559722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.560483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.562077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.573046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1030/2066] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:15:53.576953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.588753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197484d8-b5cd-418c-baa0-7a4835e10c3d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.593418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5f89f-9343-47fb-82e5-fa3a85b349d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.594016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f89f-9343-47fb-82e5-fa3a85b349d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.594296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f89f-9343-47fb-82e5-fa3a85b349d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.594576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5f89f-9343-47fb-82e5-fa3a85b349d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.595298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5f89f-9343-47fb-82e5-fa3a85b349d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.597516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5f89f-9343-47fb-82e5-fa3a85b349d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.611162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1037/2067] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:53.612051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.622781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677318-2907-4f53-8ffe-72b9e6202271 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.627950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.628741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.629025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.629804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] PATH_INFO: `/v3/projects/0f64ce9e4c104bdca6556357a34ce0a4/users/240f4f0adc1042a9a9a732bf7f589d8a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.645774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f64ce9e4c104bdca6556357a34ce0a4, user_id=240f4f0adc1042a9a9a732bf7f589d8a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.648481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:53.765981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1031/2068] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:53 2022] PUT /identity/v3/projects/0f64ce9e4c104bdca6556357a34ce0a4/users/240f4f0adc1042a9a9a732bf7f589d8a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:15:53.778370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.778658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.778933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.807163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] MFA Rules not processed for user `240f4f0adc1042a9a9a732bf7f589d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:53.808331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:53.870067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1038/2069] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:53.874585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:53.934426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018a0f3-c95a-4970-b7f1-01d06e3847a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:53.938957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:53.939639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:53.939952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:53.940230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:53.940910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:53.943410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.024240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1032/2070] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:15:53 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:54.028220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:54.038592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8d0f-8cc2-4cd9-81f8-d3de815b9eaa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:54.064801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:54.095195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:54.095872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.096156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.096429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.097116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:54.099195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.179711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1039/2071] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:15:54 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:15:54.183408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:54.194383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f9435-632a-48e6-9fbf-8432733e0339 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:54.208299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:54.208299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.208299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.208299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.208684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:54.208684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.213208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1033/2072] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:54.217182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:54.227007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66224948-ef0e-4e3a-9f0e-670ce316beb2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:54.231591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:54.232684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.232967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.233243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] PATH_INFO: `/v3/projects/d181b3c834fa4496be63e1af9c68d42c/users/c15f7eb24d954d6c9c5a34031cda1c6b/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.248604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d181b3c834fa4496be63e1af9c68d42c, user_id=c15f7eb24d954d6c9c5a34031cda1c6b, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:54.251240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.315195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1040/2073] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:54 2022] PUT /identity/v3/projects/d181b3c834fa4496be63e1af9c68d42c/users/c15f7eb24d954d6c9c5a34031cda1c6b/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:54.319658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:54.329551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837ffb0-06c1-4491-a404-cb9835af3d69 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:54.350592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:54.389191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa802b-60f2-4ec8-a44c-671220f2a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:54.389862 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa802b-60f2-4ec8-a44c-671220f2a828 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.394657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa802b-60f2-4ec8-a44c-671220f2a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.394657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa802b-60f2-4ec8-a44c-671220f2a828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.394657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa802b-60f2-4ec8-a44c-671220f2a828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:54.394657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa802b-60f2-4ec8-a44c-671220f2a828 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.403061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1034/2074] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:15:54.407149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:54.417939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0886a-d30a-4dee-aa5d-0432912f25d8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:54.422551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:54.426236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.426236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.426236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] PATH_INFO: `/v3/projects/d181b3c834fa4496be63e1af9c68d42c/users/c15f7eb24d954d6c9c5a34031cda1c6b/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.426236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d181b3c834fa4496be63e1af9c68d42c, user_id=c15f7eb24d954d6c9c5a34031cda1c6b, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:54.428851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.439911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1041/2075] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:15:54 2022] PUT /identity/v3/projects/d181b3c834fa4496be63e1af9c68d42c/users/c15f7eb24d954d6c9c5a34031cda1c6b/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:54.450995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.453042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.453042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.479197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] MFA Rules not processed for user `c15f7eb24d954d6c9c5a34031cda1c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:54.480431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:54.545751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1035/2076] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:15:54.556549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:54.558304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:54.616853 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d452ab-c6e4-44a1-a93b-dc456e238d3c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:54.620518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:54.621154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:54.621433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:54.621796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:54.631142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:54.632605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:54.642140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1042/2077] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:55.775602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:55.777148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:55.788858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f708d-04a5-4557-ab72-26da558b80b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:55.792336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d350c43-7753-4667-b896-e8a8599d792a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:55.792968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350c43-7753-4667-b896-e8a8599d792a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:55.793251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350c43-7753-4667-b896-e8a8599d792a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:55.793527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350c43-7753-4667-b896-e8a8599d792a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:55.857390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d350c43-7753-4667-b896-e8a8599d792a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:55.858994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d350c43-7753-4667-b896-e8a8599d792a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:55.874805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1036/2078] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:57.922397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:57.923906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:57.988177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd9bd7-c123-4df6-9894-8b76d6113464 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:57.992795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:57.993656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:57.993940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:57.994236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] PATH_INFO: `/v3/users/ee54b7ce99db4a46b635a9e219f5772b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:57.995391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee54b7ce99db4a46b635a9e219f5772b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:57.997347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:58.110755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:58.269233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee54b7ce99db4a46b635a9e219f5772b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:58.284088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee54b7ce99db4a46b635a9e219f5772b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:58.284803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee54b7ce99db4a46b635a9e219f5772b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:58.285420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee54b7ce99db4a46b635a9e219f5772b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:58.373569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee54b7ce99db4a46b635a9e219f5772b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:58.390319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1043/2079] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:57 2022] DELETE /identity/v3/users/ee54b7ce99db4a46b635a9e219f5772b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:58.394943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:58.395448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:58.395577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:58.415326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:15:58.416625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:58.463371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:58.484673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1037/2080] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:15:58.494904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:58.496342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:58.558873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d75c9f-7b3f-432c-895a-01e48a16c388 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:58.562744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:58.563399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:58.563683 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:58.564026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:58.573936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:58.575392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:58.585942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1044/2081] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:15:58.980776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:58.989658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:59.000384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018ac06-e945-415f-b150-e36c51ca0af7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:59.015177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:59.016108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:59.016394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:59.016677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] PATH_INFO: `/v3/projects/589eef3655ea40bab8dc7d5e02a41bd7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:59.017893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=589eef3655ea40bab8dc7d5e02a41bd7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:59.019836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:59.121726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589eef3655ea40bab8dc7d5e02a41bd7', 'request_id': 'req-0a847fbe-189c-4e39-a908-b95d55ab74ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.128068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589eef3655ea40bab8dc7d5e02a41bd7', 'request_id': 'req-0a847fbe-189c-4e39-a908-b95d55ab74ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.134469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589eef3655ea40bab8dc7d5e02a41bd7', 'request_id': 'req-0a847fbe-189c-4e39-a908-b95d55ab74ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.200378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] The token cache is being invalidate because project 589eef3655ea40bab8dc7d5e02a41bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:15:59.200666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.201302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.202832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1038/2082] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:15:58 2022] DELETE /identity/v3/projects/589eef3655ea40bab8dc7d5e02a41bd7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:59.207176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:59.217057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d3d19-e176-4641-b26e-1886247ba799 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:15:59.280300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:15:59.281176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:15:59.281456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:15:59.281729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] PATH_INFO: `/v3/users/7011bd90ec5b44499210ad2432b4c8cb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:15:59.283250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7011bd90ec5b44499210ad2432b4c8cb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:15:59.285261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:15:59.482502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7011bd90ec5b44499210ad2432b4c8cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.485675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:59.526270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7011bd90ec5b44499210ad2432b4c8cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.526270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7011bd90ec5b44499210ad2432b4c8cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.526270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7011bd90ec5b44499210ad2432b4c8cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.607623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7011bd90ec5b44499210ad2432b4c8cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:15:59.620993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1045/2083] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:59 2022] DELETE /identity/v3/users/7011bd90ec5b44499210ad2432b4c8cb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:15:59.967240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:15:59.968681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:15:59.982696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a847fbe-189c-4e39-a908-b95d55ab74ed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.038478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.040516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.044562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.045714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.046084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.046443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] PATH_INFO: `/v3/users/65af5974951c4ea99de9f72bc2246005` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.048000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65af5974951c4ea99de9f72bc2246005)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.050772 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.055395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d0ec5-7c23-4552-b190-dcb498dfd407 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.076690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.077689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.078031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.078323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] PATH_INFO: `/v3/projects/e8f3883d57a946e59bc945c2173c5a33` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.079861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f3883d57a946e59bc945c2173c5a33)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.086871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.238172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65af5974951c4ea99de9f72bc2246005'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.238957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f3883d57a946e59bc945c2173c5a33', 'request_id': 'req-5bc8a1d3-d239-4925-b5c4-dac72571953f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.250696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65af5974951c4ea99de9f72bc2246005'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.251620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65af5974951c4ea99de9f72bc2246005'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.255249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:00.323171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f3883d57a946e59bc945c2173c5a33', 'request_id': 'req-5bc8a1d3-d239-4925-b5c4-dac72571953f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.332004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f3883d57a946e59bc945c2173c5a33', 'request_id': 'req-5bc8a1d3-d239-4925-b5c4-dac72571953f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.341752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] The token cache is being invalidate because project e8f3883d57a946e59bc945c2173c5a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:00.342126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.342698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5bc8a1d3-d239-4925-b5c4-dac72571953f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.344588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1046/2084] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:00 2022] DELETE /identity/v3/projects/e8f3883d57a946e59bc945c2173c5a33 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:00.348928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fd8f-cbda-43aa-b0bc-9f50a54d6476 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.349273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fd8f-cbda-43aa-b0bc-9f50a54d6476 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.350076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5fd8f-cbda-43aa-b0bc-9f50a54d6476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.368750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0ac5fd8f-cbda-43aa-b0bc-9f50a54d6476 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:00.369950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ac5fd8f-cbda-43aa-b0bc-9f50a54d6476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.400447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65af5974951c4ea99de9f72bc2246005'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.401234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c021be42-4705-4790-85fc-f3681172e30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65af5974951c4ea99de9f72bc2246005'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:00.421912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1039/2085] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:15:59 2022] DELETE /identity/v3/users/65af5974951c4ea99de9f72bc2246005 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:00.426469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.426834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.427112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.448865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:00.450259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.451528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1047/2086] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:00.460619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.460905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.461210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.481795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:00.483001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.517408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1040/2087] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:00.527790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.529266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.535044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:00.553352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1048/2088] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:00.557708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.567221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5c83-1394-42ee-9385-ce96ad04f2b7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.573833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.573833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.573833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.573833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.574170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:00.574381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.576192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.588257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1049/2089] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:16:00.592679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.603066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2b68f-fc9c-47b0-81a0-c705fbecc2b4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.610635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cfbfe-b36a-4150-9a46-7983478628a9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.612195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.612985 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.613327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.613613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.614298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.616085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.616716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.616887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.617040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.617277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.627980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.630179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.641091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1041/2090] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:00.736823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1050/2091] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:00 2022] POST /identity/v3/projects => generated 409 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:00.738291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.748724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494a2ef-9e55-4d7d-8c9a-1666dd6797a5 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.813306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.813987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.814278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.814561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.815269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.817361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.919380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.921289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.940071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1042/2092] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:00 2022] POST /identity/v3/users => generated 305 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:00.946762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.958209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a9311-9267-429c-a5a2-45b08e389bae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.964658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.965329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.965616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.965895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.966633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:00.968352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:00.980491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1043/2093] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:00.985446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:00.985675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2e844-2d37-4b82-aa73-fc60bd497d9f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:00.989374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:00.990646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:00.990646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:00.990935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:00.992722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:00.997200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8e077-54a0-42c4-a7cb-1434321558b5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.002499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.002991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.003309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.003735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.004522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.006389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.009094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:01.026826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1044/2094] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:01.029833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.040565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d283e9a-b332-4f3a-9027-96d7423c6569 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.048124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11637-1b84-419b-8512-a4fe03e875ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.048124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11637-1b84-419b-8512-a4fe03e875ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.048124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11637-1b84-419b-8512-a4fe03e875ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.048124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11637-1b84-419b-8512-a4fe03e875ce admin admin] PATH_INFO: `/v3/projects/2bfe5815616d45acb0d0af0c10b05074/users/e9c01102fc804f45a5e9b3072058841f/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.061220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.062440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11637-1b84-419b-8512-a4fe03e875ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfe5815616d45acb0d0af0c10b05074, user_id=e9c01102fc804f45a5e9b3072058841f, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.062813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.065294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11637-1b84-419b-8512-a4fe03e875ce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.073727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1051/2095] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:01.090087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.091773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:01.115981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272a832-7082-47d1-a5aa-4cb783068cb6 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.121617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.122521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.122799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.123075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] PATH_INFO: `/v3/projects/6cd58c1c95c54abc92b3082af7be9bab` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.124371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd58c1c95c54abc92b3082af7be9bab)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.126353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.128586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1045/2096] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:01 2022] PUT /identity/v3/projects/2bfe5815616d45acb0d0af0c10b05074/users/e9c01102fc804f45a5e9b3072058841f/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:01.141348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d665b-8455-4655-ba77-9901414b8779 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.141638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d665b-8455-4655-ba77-9901414b8779 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.141922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d665b-8455-4655-ba77-9901414b8779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.172380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-877d665b-8455-4655-ba77-9901414b8779 None None] MFA Rules not processed for user `e9c01102fc804f45a5e9b3072058841f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:01.173966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-877d665b-8455-4655-ba77-9901414b8779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:01.242700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1046/2097] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:01.247016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d665b-8455-4655-ba77-9901414b8779 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.270062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd58c1c95c54abc92b3082af7be9bab', 'request_id': 'req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:01.307970 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d665b-8455-4655-ba77-9901414b8779 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.338624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd58c1c95c54abc92b3082af7be9bab', 'request_id': 'req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:01.345503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd58c1c95c54abc92b3082af7be9bab', 'request_id': 'req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:01.347546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:01.356265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] The token cache is being invalidate because project 6cd58c1c95c54abc92b3082af7be9bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:01.356563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:01.357546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-64296f23-3bc2-4e0a-9bb0-298f3cbc0bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:01.358833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1052/2098] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:01 2022] DELETE /identity/v3/projects/6cd58c1c95c54abc92b3082af7be9bab => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:01.363693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64905f-3ce3-4652-9d57-6075fd1e5827 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.364016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64905f-3ce3-4652-9d57-6075fd1e5827 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.364298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64905f-3ce3-4652-9d57-6075fd1e5827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.369677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.370470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.370756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.371042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.371836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.375387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.386617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bd64905f-3ce3-4652-9d57-6075fd1e5827 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:01.388026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd64905f-3ce3-4652-9d57-6075fd1e5827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:01.397800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1053/2099] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:01.406230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.406491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.406772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.426249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:01.440466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:01.442183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:01.456829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1054/2100] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:01.461641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.470649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea9018-29ed-4f24-b7e8-b4351516a988 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.475447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.476149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.476566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.476856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.477584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:01.477922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.479578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.492087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1055/2101] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:16:01.496370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.507629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4369e7-d691-445a-ae52-962bcae1154c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.512714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.513383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.513518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1047/2102] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/projects => generated 409 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:01.513748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.514090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.514820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.516893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.517309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.518912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:01.586126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9640b2-69f1-4e7f-af3a-99378fd2d260 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.590934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.594573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.594573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.594573 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.595948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.597899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.621399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1056/2103] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:01.624950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.687753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e47e3-35cf-49a2-889b-c0179750dcfb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.692640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.694037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.694322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.694596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.695274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.697335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.717651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1048/2104] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:01.721486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.731540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f25189-76d7-4adf-83ec-24a2a4f348a9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.736216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.736857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.737145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.737429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.738161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.740377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.750358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1049/2105] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:01.754414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.764800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc4c94-bbc7-4df5-b4b8-f6ffef3e9d37 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.769911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.770833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.771152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.772316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] PATH_INFO: `/v3/projects/ad73758a010f41238dcd24c0d426e754/users/47bbc9378e7b41b7ad0aa494c25eae47/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.787425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad73758a010f41238dcd24c0d426e754, user_id=47bbc9378e7b41b7ad0aa494c25eae47, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.790162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.811825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1057/2106] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:01 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:01.824529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.844062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb761-de72-4a1c-9f41-17df72f0ffd9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.847414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.848174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.848557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.848883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.849619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.851564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.867055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1058/2107] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:01.868481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.876434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1050/2108] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:01 2022] PUT /identity/v3/projects/ad73758a010f41238dcd24c0d426e754/users/47bbc9378e7b41b7ad0aa494c25eae47/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:01.879195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2fc5b-4a79-49fe-946e-79bd709220b7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.881098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.952597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.953939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.954443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.954898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.956828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.959278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.980626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1059/2109] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:01.981628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:01.981903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b144daf-c0bc-428d-a7ec-4bcfd143dec3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:01.989513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:01.989773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:01.992077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:01.992077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:01.992503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:01.994154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:01.994704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a41c-a93f-44ae-a88b-ab7ce1ace017 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:02.000328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2202dda-9934-4126-b8d5-0f055b2a1b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:02.001303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2202dda-9934-4126-b8d5-0f055b2a1b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:02.001663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2202dda-9934-4126-b8d5-0f055b2a1b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:02.002014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2202dda-9934-4126-b8d5-0f055b2a1b01 admin admin] PATH_INFO: `/v3/projects/4fff8f607b02433bbd69a45090a6d340/users/633d3c443cce4fbe856672ea3167de76/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:02.007996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1051/2110] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:02.012330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:02.034813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2202dda-9934-4126-b8d5-0f055b2a1b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fff8f607b02433bbd69a45090a6d340, user_id=633d3c443cce4fbe856672ea3167de76, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:02.035015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979bacc-39d8-48c5-83f5-0bb380b0be4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:02.035097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2202dda-9934-4126-b8d5-0f055b2a1b01 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:02.035186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72075b3-a85c-46c6-aa01-aa532e19075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:02.035883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72075b3-a85c-46c6-aa01-aa532e19075e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:02.036254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72075b3-a85c-46c6-aa01-aa532e19075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:02.038138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72075b3-a85c-46c6-aa01-aa532e19075e admin admin] PATH_INFO: `/v3/projects/ad73758a010f41238dcd24c0d426e754/users/47bbc9378e7b41b7ad0aa494c25eae47/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:02.039675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72075b3-a85c-46c6-aa01-aa532e19075e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad73758a010f41238dcd24c0d426e754, user_id=47bbc9378e7b41b7ad0aa494c25eae47, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:02.040236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:02.042521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72075b3-a85c-46c6-aa01-aa532e19075e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:02.053737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1052/2111] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:02 2022] PUT /identity/v3/projects/ad73758a010f41238dcd24c0d426e754/users/47bbc9378e7b41b7ad0aa494c25eae47/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:02.064007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:02.064303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:02.064597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:02.093727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] MFA Rules not processed for user `47bbc9378e7b41b7ad0aa494c25eae47`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:02.095059 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:02.117605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:02.124589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1060/2112] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:01 2022] PUT /identity/v3/projects/4fff8f607b02433bbd69a45090a6d340/users/633d3c443cce4fbe856672ea3167de76/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:02.135741 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:02.136032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:02.136315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:02.172392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] MFA Rules not processed for user `633d3c443cce4fbe856672ea3167de76`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:02.173666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:02.175668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1053/2113] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:02.188020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:02.189461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:02.255588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925fcee-0355-4627-ab1e-d001a74e40d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:02.256339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1061/2114] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:02.308681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:02.309340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:02.309622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:02.309967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:02.375671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:02.377067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:02.387197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1054/2115] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:02.436594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:02.454096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb0be4-4a18-44a1-bcac-36ed20c3e521 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:02.458012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:02.459176 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:02.459460 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:02.459971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:02.469664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:02.471238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:02.482809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1062/2116] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:03.071557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:03.073037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:03.084954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598c44c-1bcb-404e-81d4-37f9c57cf903 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:03.088878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:03.089568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:03.089911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:03.090193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:03.092032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:03.114574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:03.179384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:03.179384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:03.190576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1055/2117] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:05.728204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:05.836758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f85d0b-97e5-4a31-846d-0ceae60ada02 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:05.841537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:05.842407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:05.842691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:05.842966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] PATH_INFO: `/v3/users/633d3c443cce4fbe856672ea3167de76` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:05.844186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] RBAC: Authorizing `identity:delete_user(user_id=633d3c443cce4fbe856672ea3167de76)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:05.846186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:06.041904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:06.055549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633d3c443cce4fbe856672ea3167de76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.067151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633d3c443cce4fbe856672ea3167de76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.068503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633d3c443cce4fbe856672ea3167de76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.069323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633d3c443cce4fbe856672ea3167de76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.148957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f73c3bff-cc63-4f7b-82d9-0c0e39ca577e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633d3c443cce4fbe856672ea3167de76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.160950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:06.162140 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1063/2118] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:05 2022] DELETE /identity/v3/users/633d3c443cce4fbe856672ea3167de76 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:06.162741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:06.166232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:06.166523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:06.166801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:06.216474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6041-9704-4e09-abca-fa7d9a17bd62 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:06.216666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:06.217848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:06.271964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:06.272841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:06.273122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:06.273395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] PATH_INFO: `/v3/users/8805cf96fc1b417e964f50883c7f88cc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:06.274590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8805cf96fc1b417e964f50883c7f88cc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:06.276523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:06.276657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1064/2119] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:06.286059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:06.287455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:06.377458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:06.382395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac36081-f8b8-4c41-85a0-f341e9464342 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:06.386081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681d006-c381-47bf-a883-62d0309361df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:06.386732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681d006-c381-47bf-a883-62d0309361df service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:06.387019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681d006-c381-47bf-a883-62d0309361df service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:06.387297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681d006-c381-47bf-a883-62d0309361df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:06.396463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681d006-c381-47bf-a883-62d0309361df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:06.397913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681d006-c381-47bf-a883-62d0309361df service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:06.407878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1065/2120] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:06.413223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8805cf96fc1b417e964f50883c7f88cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.425836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8805cf96fc1b417e964f50883c7f88cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.426529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8805cf96fc1b417e964f50883c7f88cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.487726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8805cf96fc1b417e964f50883c7f88cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.488528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8805cf96fc1b417e964f50883c7f88cc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:06.504782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1056/2121] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:06 2022] DELETE /identity/v3/users/8805cf96fc1b417e964f50883c7f88cc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:06.510150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:06.510544 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:06.510897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:06.529736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:06.530950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:06.595382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1066/2122] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:06.602332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:06.604415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:06.611488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:06.670906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd9e8-6b7e-4dc3-a5b5-0b04d7372f09 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:06.677327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653590f-83c0-42ad-8c2d-27043005eab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:06.678021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653590f-83c0-42ad-8c2d-27043005eab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:06.678307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653590f-83c0-42ad-8c2d-27043005eab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:06.678583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653590f-83c0-42ad-8c2d-27043005eab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:06.689279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653590f-83c0-42ad-8c2d-27043005eab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:06.690896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653590f-83c0-42ad-8c2d-27043005eab5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:06.702699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1057/2123] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:06.905209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:06.906685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:06.919531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766f3ae-9fc2-4a65-9eb8-99d3dc17a9cc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:06.924067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:06.924934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:06.925290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:06.925576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] PATH_INFO: `/v3/projects/4fff8f607b02433bbd69a45090a6d340` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:06.926764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fff8f607b02433bbd69a45090a6d340)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:06.928846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.042295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fff8f607b02433bbd69a45090a6d340', 'request_id': 'req-e8891365-28a4-4f17-aa94-bbb8d5468ba5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.114131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fff8f607b02433bbd69a45090a6d340', 'request_id': 'req-e8891365-28a4-4f17-aa94-bbb8d5468ba5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.120881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fff8f607b02433bbd69a45090a6d340', 'request_id': 'req-e8891365-28a4-4f17-aa94-bbb8d5468ba5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.131766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] The token cache is being invalidate because project 4fff8f607b02433bbd69a45090a6d340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:07.132073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.132696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.134209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1067/2124] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:06 2022] DELETE /identity/v3/projects/4fff8f607b02433bbd69a45090a6d340 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:07.139187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8717f-4d80-4c42-a3fa-3217b3fd85bf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.139476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8717f-4d80-4c42-a3fa-3217b3fd85bf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.139752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8717f-4d80-4c42-a3fa-3217b3fd85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.185867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-73b8717f-4d80-4c42-a3fa-3217b3fd85bf None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:07.187090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73b8717f-4d80-4c42-a3fa-3217b3fd85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:07.202629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.204056 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:07.251918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1058/2125] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:07.260152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.260550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.260898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.279087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:07.280302 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:07.283626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891365-28a4-4f17-aa94-bbb8d5468ba5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.288258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.291572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1059/2126] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:07.291734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.291734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.291734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] PATH_INFO: `/v3/projects/63ab6a2be0d14eebad98a79239cab28d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.291734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ab6a2be0d14eebad98a79239cab28d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.292568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.293033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.303439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77242922-0b1c-46ad-8e61-37dd5e83f1a1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.308781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.309433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.309716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.309998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.310720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:07.311029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.312322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:07.312703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.325157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1060/2127] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:16:07.329512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.342209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6fd79-969a-45be-8004-0934edb4cd96 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.344241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.344868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.345153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.345431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.346106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.348007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.431674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ab6a2be0d14eebad98a79239cab28d', 'request_id': 'req-23da9d1b-a98d-46c2-8c86-55206b1e12a7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.477679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1061/2128] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:07 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:07.482271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.499106 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ab6a2be0d14eebad98a79239cab28d', 'request_id': 'req-23da9d1b-a98d-46c2-8c86-55206b1e12a7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.507979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ab6a2be0d14eebad98a79239cab28d', 'request_id': 'req-23da9d1b-a98d-46c2-8c86-55206b1e12a7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.517475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] The token cache is being invalidate because project 63ab6a2be0d14eebad98a79239cab28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:07.517766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.518423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.520006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1068/2129] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:07 2022] DELETE /identity/v3/projects/63ab6a2be0d14eebad98a79239cab28d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:07.524408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.525829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:07.529095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:07.547425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78845c-b123-45d6-ba95-e66520962ed5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.554148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.555004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.555353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.555637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.556377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.559599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.595424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da9d1b-a98d-46c2-8c86-55206b1e12a7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.601052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.601939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.602223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.602517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] PATH_INFO: `/v3/users/240f4f0adc1042a9a9a732bf7f589d8a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.603713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] RBAC: Authorizing `identity:delete_user(user_id=240f4f0adc1042a9a9a732bf7f589d8a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.605755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.630569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1062/2130] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:07 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:07.634665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.636416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:07.649803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd076f-d202-40bc-a191-80a0b921361e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.654527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.655205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.655488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.655769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.656529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.658125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.669100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1063/2131] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:07.672947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.683118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800adc3-8585-4dc0-99fe-4e3a08e44313 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.687786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.688424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.688713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.688999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.689700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.691265 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.702494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1064/2132] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:07.711009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:07.720338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fb34b-7443-4825-a0d1-63a969d0f07c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:07.725408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c136a-407f-42c2-a52f-b50ea6c0a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:07.726269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c136a-407f-42c2-a52f-b50ea6c0a3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.726557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c136a-407f-42c2-a52f-b50ea6c0a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.726835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c136a-407f-42c2-a52f-b50ea6c0a3c2 admin admin] PATH_INFO: `/v3/projects/aad279f327e44c9ebcf8c467a238059b/users/8e521f65a3444932a9fd7ee95be8cf8a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.743268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c136a-407f-42c2-a52f-b50ea6c0a3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad279f327e44c9ebcf8c467a238059b, user_id=8e521f65a3444932a9fd7ee95be8cf8a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:07.746009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c136a-407f-42c2-a52f-b50ea6c0a3c2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:07.784129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240f4f0adc1042a9a9a732bf7f589d8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.806067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240f4f0adc1042a9a9a732bf7f589d8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.806067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240f4f0adc1042a9a9a732bf7f589d8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.806067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240f4f0adc1042a9a9a732bf7f589d8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.858843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1065/2133] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:07 2022] PUT /identity/v3/projects/aad279f327e44c9ebcf8c467a238059b/users/8e521f65a3444932a9fd7ee95be8cf8a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:07.870998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:07.871288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:07.871603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:07.885830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240f4f0adc1042a9a9a732bf7f589d8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:07.901940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1069/2134] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:07 2022] DELETE /identity/v3/users/240f4f0adc1042a9a9a732bf7f589d8a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:07.905665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] MFA Rules not processed for user `8e521f65a3444932a9fd7ee95be8cf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:07.906878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:07.988242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1066/2135] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:08.000342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:08.001838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:08.028321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:08.060354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ce010-8cc4-42d2-bf26-d473cff9750b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:08.064024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:08.064667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:08.064953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:08.065257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:08.073651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:08.075096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:08.084581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1070/2136] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:08.351281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:08.352832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:08.419247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fb921-301b-4e73-946f-cc2ce0beed90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:08.423703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:08.424587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:08.424886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:08.425148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] PATH_INFO: `/v3/projects/0f64ce9e4c104bdca6556357a34ce0a4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:08.426324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f64ce9e4c104bdca6556357a34ce0a4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:08.428553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:08.446754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:08.557467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f64ce9e4c104bdca6556357a34ce0a4', 'request_id': 'req-9029aea8-0158-465e-8007-cd18c9a26514'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.564085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f64ce9e4c104bdca6556357a34ce0a4', 'request_id': 'req-9029aea8-0158-465e-8007-cd18c9a26514'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.571169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f64ce9e4c104bdca6556357a34ce0a4', 'request_id': 'req-9029aea8-0158-465e-8007-cd18c9a26514'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.653035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] The token cache is being invalidate because project 0f64ce9e4c104bdca6556357a34ce0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:08.657911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.657911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.657911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1067/2137] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:08 2022] DELETE /identity/v3/projects/0f64ce9e4c104bdca6556357a34ce0a4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:08.660662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:08.671961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce867a1-7d18-4996-bd48-19a8655d0db8 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:08.726951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:08.727842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:08.728127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:08.728397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] PATH_INFO: `/v3/users/c15f7eb24d954d6c9c5a34031cda1c6b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:08.729598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15f7eb24d954d6c9c5a34031cda1c6b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:08.731519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:08.879498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15f7eb24d954d6c9c5a34031cda1c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.891744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15f7eb24d954d6c9c5a34031cda1c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.892492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15f7eb24d954d6c9c5a34031cda1c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.897728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15f7eb24d954d6c9c5a34031cda1c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.973172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0aab4c5d-8944-4c34-82b4-271692e4c5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15f7eb24d954d6c9c5a34031cda1c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:08.987182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1071/2138] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:08 2022] DELETE /identity/v3/users/c15f7eb24d954d6c9c5a34031cda1c6b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:09.397489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:09.399035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:09.412458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029aea8-0158-465e-8007-cd18c9a26514 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:09.471905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:09.472787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:09.473050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:09.473322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] PATH_INFO: `/v3/projects/d181b3c834fa4496be63e1af9c68d42c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:09.474528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d181b3c834fa4496be63e1af9c68d42c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:09.476465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:09.606515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd181b3c834fa4496be63e1af9c68d42c', 'request_id': 'req-6d8bfd14-2a69-45d2-a5db-7946a93125f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:09.612901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd181b3c834fa4496be63e1af9c68d42c', 'request_id': 'req-6d8bfd14-2a69-45d2-a5db-7946a93125f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:09.618638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd181b3c834fa4496be63e1af9c68d42c', 'request_id': 'req-6d8bfd14-2a69-45d2-a5db-7946a93125f9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:09.696528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] The token cache is being invalidate because project d181b3c834fa4496be63e1af9c68d42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:09.696848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:09.698336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d8bfd14-2a69-45d2-a5db-7946a93125f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:09.699134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1068/2139] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:09 2022] DELETE /identity/v3/projects/d181b3c834fa4496be63e1af9c68d42c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:09.705210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:09.705733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:09.705819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:09.725243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:09.726482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:09.767385 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:09.785565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1072/2140] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:09.793959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:09.794261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:09.794542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:09.813952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:09.815138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:09.824397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1069/2141] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:09.829444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:09.852256 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f8589-9e24-45c2-8263-891b8f9fc3c7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:09.856974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:09.857650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:09.857936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:09.858218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:09.858977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:09.859263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:09.860929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:09.876842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1073/2142] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:16:09.884098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:09.896178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab9d82-7051-42b2-a464-7c0f9e631b02 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:09.901462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:09.902172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:09.902462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:09.902739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:09.903432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:09.906378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:09.998021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1070/2143] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:09 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:10.002051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:10.012812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea09dd-6fce-4f36-894d-d3c16d41cf47 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:10.069244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:10.069899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:10.070180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:10.070450 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:10.071120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:10.073077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:10.183718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1074/2144] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:10 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:10.184857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:10.207887 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f06ec6-8604-483a-85f1-7a6749c6930f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:10.230128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:10.230816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:10.231106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:10.231386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:10.232167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:10.233780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:10.236326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:10.252841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1071/2145] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:10.257143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:10.268472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028c68-7f48-4dbc-a085-fb3c006b7237 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:10.273610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcb94a-cd5b-4e26-93e0-3b9b5dd62fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:10.274393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb94a-cd5b-4e26-93e0-3b9b5dd62fea admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:10.274746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb94a-cd5b-4e26-93e0-3b9b5dd62fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:10.275173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcb94a-cd5b-4e26-93e0-3b9b5dd62fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:10.276007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb94a-cd5b-4e26-93e0-3b9b5dd62fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:10.277732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddcb94a-cd5b-4e26-93e0-3b9b5dd62fea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:10.295630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1075/2146] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:10.297085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:10.308270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c766-a642-4432-992a-f56ab955e93e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:10.312966 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:10.315387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:10.315387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:10.315387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] PATH_INFO: `/v3/projects/17323deecc53427eab168769c3e1ab22/users/39d15f2926464275a5d3dd80af0f4fad/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:10.329871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17323deecc53427eab168769c3e1ab22, user_id=39d15f2926464275a5d3dd80af0f4fad, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:10.332854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:10.390391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1072/2147] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:10 2022] PUT /identity/v3/projects/17323deecc53427eab168769c3e1ab22/users/39d15f2926464275a5d3dd80af0f4fad/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:10.402765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178010-078f-4352-861a-ed7abc273315 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:10.403063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178010-078f-4352-861a-ed7abc273315 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:10.403337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178010-078f-4352-861a-ed7abc273315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:10.433478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-93178010-078f-4352-861a-ed7abc273315 None None] MFA Rules not processed for user `39d15f2926464275a5d3dd80af0f4fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:10.434849 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93178010-078f-4352-861a-ed7abc273315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:10.507267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1076/2148] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:10.518833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:10.521596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:10.580489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ce114-6219-4b9d-9e3d-2a2c26f39b91 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:10.584436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18ad8c-d738-4f74-b0b5-34d2a7d8f0ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:10.585092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ad8c-d738-4f74-b0b5-34d2a7d8f0ed service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:10.586951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ad8c-d738-4f74-b0b5-34d2a7d8f0ed service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:10.586951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18ad8c-d738-4f74-b0b5-34d2a7d8f0ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:10.594076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ad8c-d738-4f74-b0b5-34d2a7d8f0ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:10.595510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18ad8c-d738-4f74-b0b5-34d2a7d8f0ed service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:10.604455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1073/2149] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:13.598357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178010-078f-4352-861a-ed7abc273315 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:13.599846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93178010-078f-4352-861a-ed7abc273315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:13.642596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:13.663781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178010-078f-4352-861a-ed7abc273315 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:13.668381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:13.669253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:13.669539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:13.669819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] PATH_INFO: `/v3/users/e9c01102fc804f45a5e9b3072058841f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:13.671016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c01102fc804f45a5e9b3072058841f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:13.673017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:13.848609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c01102fc804f45a5e9b3072058841f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:13.860625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c01102fc804f45a5e9b3072058841f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:13.861287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c01102fc804f45a5e9b3072058841f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:13.861893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c01102fc804f45a5e9b3072058841f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:13.914313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c01102fc804f45a5e9b3072058841f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:13.927856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1077/2150] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:13 2022] DELETE /identity/v3/users/e9c01102fc804f45a5e9b3072058841f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:13.932334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:13.932846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:13.932955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:13.951577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:13.952257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:14.015241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1074/2151] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:14.025886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:14.027339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:14.086038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a37f7a-d68b-47ba-b2b1-55de202f80f1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:14.090041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:14.090696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:14.090986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:14.091296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:14.100889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:14.102334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:14.111694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1078/2152] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:14.523385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:14.524844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:14.537575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc714-4bf4-4308-9b5b-873b0464a037 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:14.542886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:14.543767 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:14.544093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:14.546702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] PATH_INFO: `/v3/projects/2bfe5815616d45acb0d0af0c10b05074` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:14.546702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfe5815616d45acb0d0af0c10b05074)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:14.548228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:14.653235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfe5815616d45acb0d0af0c10b05074', 'request_id': 'req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:14.659508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfe5815616d45acb0d0af0c10b05074', 'request_id': 'req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:14.665855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfe5815616d45acb0d0af0c10b05074', 'request_id': 'req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:14.750599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:14.755322 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] The token cache is being invalidate because project 2bfe5815616d45acb0d0af0c10b05074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:14.755775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:14.756765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:14.758707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1075/2153] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:14 2022] DELETE /identity/v3/projects/2bfe5815616d45acb0d0af0c10b05074 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:14.763088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:14.773724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00cb07-9582-4f17-b90a-952c9bcafe36 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:14.835224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:14.836142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:14.836426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:14.836699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] PATH_INFO: `/v3/users/47bbc9378e7b41b7ad0aa494c25eae47` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:14.837903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bbc9378e7b41b7ad0aa494c25eae47)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:14.840007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:14.842505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:15.044237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bbc9378e7b41b7ad0aa494c25eae47'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.056690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bbc9378e7b41b7ad0aa494c25eae47'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.057567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bbc9378e7b41b7ad0aa494c25eae47'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.058464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bbc9378e7b41b7ad0aa494c25eae47'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.150067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b0b52fc8-30c6-4059-b136-bb5ab3aa9a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bbc9378e7b41b7ad0aa494c25eae47'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.162965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1079/2154] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:14 2022] DELETE /identity/v3/users/47bbc9378e7b41b7ad0aa494c25eae47 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:15.638490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:15.640433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:15.655228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc380b2c-1f95-4cbe-963b-bf4760ce3ac6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:15.726022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:15.726022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:15.726022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:15.726022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] PATH_INFO: `/v3/projects/ad73758a010f41238dcd24c0d426e754` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:15.726453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad73758a010f41238dcd24c0d426e754)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:15.727677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:15.847701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad73758a010f41238dcd24c0d426e754', 'request_id': 'req-d3f21745-a5d4-46a0-bad0-8c9e07df531c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.854702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad73758a010f41238dcd24c0d426e754', 'request_id': 'req-d3f21745-a5d4-46a0-bad0-8c9e07df531c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.860227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad73758a010f41238dcd24c0d426e754', 'request_id': 'req-d3f21745-a5d4-46a0-bad0-8c9e07df531c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.978466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] The token cache is being invalidate because project ad73758a010f41238dcd24c0d426e754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:15.978796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.979473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3f21745-a5d4-46a0-bad0-8c9e07df531c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:15.981008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1076/2155] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:15 2022] DELETE /identity/v3/projects/ad73758a010f41238dcd24c0d426e754 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:15.986081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:15.986840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:15.986840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.013781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:16.013781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:16.076851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1080/2156] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:16.085497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.085791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.086077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.110406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:16.111618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:16.120831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1077/2157] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:16.125692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.136405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c3f47-ab91-4ba0-85d0-9684345d01f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.141838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.142508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.142793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.143070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.143829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:16.144147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.146720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.163830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1081/2158] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:16:16.168303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.177652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc79b8d-fcde-4450-b337-3a1d1ab9a116 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.182384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.183041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.183330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.183612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.184382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.186293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.306392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1078/2159] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:16 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:16.310518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.320826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb5f5c-aa70-46f4-9ab7-3ab912bd76c6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.378343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.379023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.379310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.379588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.380458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.382430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.504718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:16.510966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1082/2160] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:16 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:16.515137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.526035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5a6d9-6bfa-431c-a0a8-e535700b141e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.531295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.532088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.532379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.532982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.534007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.539115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.551460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1079/2161] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:16.555650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.566676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b9acb-37e9-4210-add0-9908e26ebbb7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.571645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e61a45-3a1b-4d91-a126-2c9a67798a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.572329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61a45-3a1b-4d91-a126-2c9a67798a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.572608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61a45-3a1b-4d91-a126-2c9a67798a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.572883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e61a45-3a1b-4d91-a126-2c9a67798a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.573607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e61a45-3a1b-4d91-a126-2c9a67798a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.575201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e61a45-3a1b-4d91-a126-2c9a67798a0c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.592250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1083/2162] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:16.602359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.612908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326c549-9206-4b0a-933f-e76831e52b62 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.618134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.619074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.619356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.619632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] PATH_INFO: `/v3/projects/e08cc9ff39e34289add6298f9b6c81cc/users/1bca01cd607845a581d41f0095a55d53/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.634929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08cc9ff39e34289add6298f9b6c81cc, user_id=1bca01cd607845a581d41f0095a55d53, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.637632 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.717724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1080/2163] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:16 2022] PUT /identity/v3/projects/e08cc9ff39e34289add6298f9b6c81cc/users/1bca01cd607845a581d41f0095a55d53/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:16.733811 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ed9b-b738-4a11-b5c5-4027396731d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.734510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ed9b-b738-4a11-b5c5-4027396731d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.734912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3ed9b-b738-4a11-b5c5-4027396731d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.766137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eff3ed9b-b738-4a11-b5c5-4027396731d0 None None] MFA Rules not processed for user `1bca01cd607845a581d41f0095a55d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:16.767357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eff3ed9b-b738-4a11-b5c5-4027396731d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:16.837695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1084/2164] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:16.848911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:16.855285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:16.886597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:16.917678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3e96-9117-4dd2-beaf-3b1f362c8e33 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:16.921491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:16.922138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:16.922420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:16.922697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:16.931360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:16.932815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:16.942545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1081/2165] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:26.863386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=38 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:27.246975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=15 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:42.261175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed060f2-fd42-448b-8568-6265e40ceaa7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:42.261635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed060f2-fd42-448b-8568-6265e40ceaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:42.261878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed060f2-fd42-448b-8568-6265e40ceaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:42.279734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bed060f2-fd42-448b-8568-6265e40ceaa7 None None] MFA Rules not processed for user `04058cb7cf374eba92fb7ee796084e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:42.280923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bed060f2-fd42-448b-8568-6265e40ceaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:42.336693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1085/2166] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:46.530863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:46.532336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:46.605274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db9a66-614f-4a1c-ba6a-bc49beddcfeb service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:46.609956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:46.610858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:46.611138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:46.612197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] PATH_INFO: `/v3/users/029d9b8a8e45449884d422288623d40a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:46.613545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=029d9b8a8e45449884d422288623d40a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:46.615727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:46.855783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029d9b8a8e45449884d422288623d40a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:46.870981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029d9b8a8e45449884d422288623d40a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:46.875676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029d9b8a8e45449884d422288623d40a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:46.956975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029d9b8a8e45449884d422288623d40a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:46.957618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029d9b8a8e45449884d422288623d40a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:46.984442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1082/2167] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:46 2022] DELETE /identity/v3/users/029d9b8a8e45449884d422288623d40a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:46.987754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:46.988240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:46.988333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:47.015016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:47.016557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:47.101082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1086/2168] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:47.112165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:47.114473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:47.197875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc77f-6ce2-4109-9557-7fae943c1e5d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:47.232062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478477d-98a0-4af5-a3a2-29817ae1eea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:47.233472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478477d-98a0-4af5-a3a2-29817ae1eea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:47.233809 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478477d-98a0-4af5-a3a2-29817ae1eea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:47.234199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478477d-98a0-4af5-a3a2-29817ae1eea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:47.250974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478477d-98a0-4af5-a3a2-29817ae1eea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:47.252820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478477d-98a0-4af5-a3a2-29817ae1eea4 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:47.265291 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1083/2169] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:47.820483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:47.822596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:47.847767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038aaa4-3e75-4688-a252-b109fef6b933 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:47.862345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:47.863445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:47.863842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:47.864287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] PATH_INFO: `/v3/projects/937ffebd1a9945588cfe02e2310a16d4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:47.868848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937ffebd1a9945588cfe02e2310a16d4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:47.868978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.032138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937ffebd1a9945588cfe02e2310a16d4', 'request_id': 'req-d3b81270-347c-4c6a-bce7-7e758a1c83f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.103988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937ffebd1a9945588cfe02e2310a16d4', 'request_id': 'req-d3b81270-347c-4c6a-bce7-7e758a1c83f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.111565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937ffebd1a9945588cfe02e2310a16d4', 'request_id': 'req-d3b81270-347c-4c6a-bce7-7e758a1c83f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.124585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] The token cache is being invalidate because project 937ffebd1a9945588cfe02e2310a16d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:48.125103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.125729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d3b81270-347c-4c6a-bce7-7e758a1c83f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.127971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1087/2170] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:47 2022] DELETE /identity/v3/projects/937ffebd1a9945588cfe02e2310a16d4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:48.134035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.134581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.134581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.169174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:48.170311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:48.192186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:48.262164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1084/2171] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:48.262963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.263262 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.263547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.289511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:48.290891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:48.309165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1088/2172] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:48.310517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.321392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3afe4a-7149-493a-a2b3-d0cc56d2c536 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.326089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.327056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.327407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.327755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.328685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:48.329064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.330775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.351844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1085/2173] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:16:48.352995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.363380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae338a5-0461-498c-bc97-08949fe3b802 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.369601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.370328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.370612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.370886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.375335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.380861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.485367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:48.492758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1089/2174] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:48 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:48.497028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.516578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.526044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785835bd-b528-4004-aa38-413eeb2bb0c4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.527931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:48.641374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ccf57-1300-4447-9e1c-84bc0056acd8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.647049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.648069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.648479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.648750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] PATH_INFO: `/v3/users/39d15f2926464275a5d3dd80af0f4fad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.649930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.650069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d15f2926464275a5d3dd80af0f4fad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.653316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.660811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.661226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.661608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.663235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.665344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.751832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1086/2175] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:48 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:48.756012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.767332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0578a17-ccab-4d18-9b6f-2c42e2976b98 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.772045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.773174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.773502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.773773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.774486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.776165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.788546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1087/2176] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:48.792438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.802830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b05b-179c-4a75-b235-ccfbdde4d186 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.808424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.809170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.809460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.809737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.810476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.812117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.835065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1088/2177] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:16:48.836968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:48.845108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d15f2926464275a5d3dd80af0f4fad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.854827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcce7bf-241e-4757-8e15-45f5eecc8434 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:48.861312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a4016-7f90-4afe-b703-4cf47d53c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:48.862373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4016-7f90-4afe-b703-4cf47d53c772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.862647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4016-7f90-4afe-b703-4cf47d53c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.862921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a4016-7f90-4afe-b703-4cf47d53c772 admin admin] PATH_INFO: `/v3/projects/f66c655b19c44bc9945381507a21109c/users/dea29a620c094ac6b5e90ae8bc8b7908/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.870000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d15f2926464275a5d3dd80af0f4fad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.870992 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d15f2926464275a5d3dd80af0f4fad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.871713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d15f2926464275a5d3dd80af0f4fad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.889682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4016-7f90-4afe-b703-4cf47d53c772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66c655b19c44bc9945381507a21109c, user_id=dea29a620c094ac6b5e90ae8bc8b7908, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:48.892504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a4016-7f90-4afe-b703-4cf47d53c772 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:48.933369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f48b7f7a-f7f6-4898-8158-f4b2817e68a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d15f2926464275a5d3dd80af0f4fad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:48.971170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1089/2178] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:48 2022] PUT /identity/v3/projects/f66c655b19c44bc9945381507a21109c/users/dea29a620c094ac6b5e90ae8bc8b7908/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:48.972944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.973432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.973561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:48.979088 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1090/2179] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:48 2022] DELETE /identity/v3/users/39d15f2926464275a5d3dd80af0f4fad => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:48.985147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:48.985526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:48.985890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:49.024950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] MFA Rules not processed for user `dea29a620c094ac6b5e90ae8bc8b7908`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:49.026301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:49.029669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:49.030890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:49.092954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:49.098921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1091/2180] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:49.109097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:49.112531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:49.135027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1090/2181] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:49.143611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:49.149135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:49.151349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:49.222893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d260d9-087f-47f0-b3b9-47cccd0a326a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:49.226841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:49.227581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:49.228115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:49.228473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:49.238826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:49.243908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:49.255972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1092/2182] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:49.259457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326770a-6baf-4efe-98c2-fd47d844b946 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:49.263906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2446506-a4cf-4dd2-bddc-c5a433ec1147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:49.264637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446506-a4cf-4dd2-bddc-c5a433ec1147 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:49.264991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446506-a4cf-4dd2-bddc-c5a433ec1147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:49.265345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446506-a4cf-4dd2-bddc-c5a433ec1147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:49.276220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2446506-a4cf-4dd2-bddc-c5a433ec1147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:49.277671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2446506-a4cf-4dd2-bddc-c5a433ec1147 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:49.289592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1091/2183] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:49.921247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:49.922673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:49.941194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00da6f-f24e-4140-949b-83049b56bf9f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:49.946580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:49.948854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:49.949214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:49.949431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] PATH_INFO: `/v3/projects/17323deecc53427eab168769c3e1ab22` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:49.951168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=17323deecc53427eab168769c3e1ab22)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:49.953172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.133491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17323deecc53427eab168769c3e1ab22', 'request_id': 'req-3f4dc0ea-165b-4baa-931e-84e4909c5acc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:50.208696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17323deecc53427eab168769c3e1ab22', 'request_id': 'req-3f4dc0ea-165b-4baa-931e-84e4909c5acc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:50.217826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17323deecc53427eab168769c3e1ab22', 'request_id': 'req-3f4dc0ea-165b-4baa-931e-84e4909c5acc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:50.232328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] The token cache is being invalidate because project 17323deecc53427eab168769c3e1ab22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:50.232679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:50.233628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f4dc0ea-165b-4baa-931e-84e4909c5acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:50.235744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1093/2184] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:49 2022] DELETE /identity/v3/projects/17323deecc53427eab168769c3e1ab22 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:50.240773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.241240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.241492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.264558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:50.265908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:50.333101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1092/2185] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:50.341922 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.342195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.342423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.363506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:50.364760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:50.382101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1094/2186] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:50.384560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:50.394275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74290b3-87ec-47ff-b370-192ba6c9029d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:50.399742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:50.400463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.400754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.401033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.401815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:50.402124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:50.403731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.419307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1093/2187] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:16:50.423476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:50.438962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ddf7e-28ba-48cb-bb7b-a1bbce12a110 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:50.448903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:50.449570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.449851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.450124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.450880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:50.452833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.540598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1095/2188] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:50 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:50.544874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:50.555323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702c6a2-7612-4d00-a827-5e6352cc4a25 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:50.604474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:50.613001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:50.617018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.617018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.617018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.617018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:50.617018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.679027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1094/2189] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:50 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:50.680345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:50.692089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c300a-830c-4c86-8b04-31571372b281 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:50.697455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:50.698126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.698399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.698676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.699411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:50.701028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.715039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1096/2190] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:50.717050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:50.727095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114621-8262-468c-ae97-6ec3e3761a41 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:50.734324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dd3de-777c-41a0-a039-dfa59899896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:50.734324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dd3de-777c-41a0-a039-dfa59899896b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.734324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dd3de-777c-41a0-a039-dfa59899896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.734596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dd3de-777c-41a0-a039-dfa59899896b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.735118 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dd3de-777c-41a0-a039-dfa59899896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:50.736750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0dd3de-777c-41a0-a039-dfa59899896b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.749170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1095/2191] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:50.755242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:50.767472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2b05f-d473-4ac0-bea6-b19d21f8cb22 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:50.773203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:50.778534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.778534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.778534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] PATH_INFO: `/v3/projects/e4c47dbf60e148c3a23328a4882a3aba/users/0a3244455cdc49b39f07837a30dec86a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.789566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c47dbf60e148c3a23328a4882a3aba, user_id=0a3244455cdc49b39f07837a30dec86a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:50.792276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:50.868247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1097/2192] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:50 2022] PUT /identity/v3/projects/e4c47dbf60e148c3a23328a4882a3aba/users/0a3244455cdc49b39f07837a30dec86a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:50.879136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:50.879435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:50.879720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:50.907746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] MFA Rules not processed for user `0a3244455cdc49b39f07837a30dec86a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:50.908994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:50.997458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1096/2193] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:51.001623 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.054474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:51.076069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e9000-35a9-41c3-a9a8-55b441bdab89 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.081260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.082549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.082840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.083152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.083863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.086009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:51.157944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1098/2194] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:51 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:51.161904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.173177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d8cf8-49bf-48f8-9f04-40b5e2144465 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.239068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.239777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.240089 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.240371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.241651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.243555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:51.332436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1097/2195] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:51 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:51.336798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.347227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c54789-2ad7-4a6a-afb6-2688e04d1235 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.352431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.353110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.353366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.353641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.354357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.356062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:51.367208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1099/2196] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:51.371917 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.383030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a9e45-5fc5-4beb-8c89-aea83dd67195 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.387838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93a369-9bcb-4c3c-99d2-38aaa250290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.388505 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a369-9bcb-4c3c-99d2-38aaa250290a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.388797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a369-9bcb-4c3c-99d2-38aaa250290a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.389068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93a369-9bcb-4c3c-99d2-38aaa250290a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.389799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a369-9bcb-4c3c-99d2-38aaa250290a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.391392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93a369-9bcb-4c3c-99d2-38aaa250290a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:51.402116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1098/2197] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:51.412092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.422494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3ce7-3f63-470e-84b0-06f00fdd2bb0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.427058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.428024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.432179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.432179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] PATH_INFO: `/v3/projects/88bb0113e7af4b2899ac0022b057ac81/users/decc646464f845e6aec8877d66a2b8dc/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.449357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bb0113e7af4b2899ac0022b057ac81, user_id=decc646464f845e6aec8877d66a2b8dc, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.452007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:51.590648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1100/2198] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:51 2022] PUT /identity/v3/projects/88bb0113e7af4b2899ac0022b057ac81/users/decc646464f845e6aec8877d66a2b8dc/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:51.601281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.601588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.601876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.630007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] MFA Rules not processed for user `decc646464f845e6aec8877d66a2b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:51.631823 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:51.660810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:51.697629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1099/2199] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:51.702261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.775236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a357e53-a857-4a7f-a8cb-7e82e870ff32 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.780309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.781000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.781286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.781563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.782279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.784239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:51.847995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1101/2200] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:51 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:51.852159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:51.863378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f31fd-df64-495b-9acb-3dead9675431 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:51.924345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:51.929655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:51.929655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:51.929655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:51.929655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:51.929655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.009619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1100/2201] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:51 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:16:52.011978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.022868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886e66b-6964-4aa4-9ff9-341b1ad990e7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.028263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.030012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.030012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.030012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.030696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.032862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.047520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1102/2202] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:52.051443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.063371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dc445-b71c-4d0e-bd76-6e365d56133d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.073004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.073991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.074343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.074695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] PATH_INFO: `/v3/projects/310af3bffa1d455b9eb21c7704d945e5/users/729a350efab14e37b1584fd32fefdd9a/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.097022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=310af3bffa1d455b9eb21c7704d945e5, user_id=729a350efab14e37b1584fd32fefdd9a, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.100260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.205067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.205067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:52.223023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a167718-e62f-4057-8d80-5cd86b9d4d36 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.229365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.230278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.230542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.230819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] PATH_INFO: `/v3/users/1bca01cd607845a581d41f0095a55d53` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.232082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bca01cd607845a581d41f0095a55d53)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.234027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.250227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1101/2203] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:52 2022] PUT /identity/v3/projects/310af3bffa1d455b9eb21c7704d945e5/users/729a350efab14e37b1584fd32fefdd9a/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:52.251915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.322304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0cca7-2466-4d6c-b817-d59f8e04e4dc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.326931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.327595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.327914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.328197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.328915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.330506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.340789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1102/2204] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:52.344985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.356860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025fc4d-197f-4732-a883-72e8308bda40 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.361622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d890733-f284-40ac-ba92-55e5ec11894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.362512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890733-f284-40ac-ba92-55e5ec11894c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.362798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890733-f284-40ac-ba92-55e5ec11894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.363077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d890733-f284-40ac-ba92-55e5ec11894c admin admin] PATH_INFO: `/v3/projects/310af3bffa1d455b9eb21c7704d945e5/users/729a350efab14e37b1584fd32fefdd9a/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.365110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890733-f284-40ac-ba92-55e5ec11894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=310af3bffa1d455b9eb21c7704d945e5, user_id=729a350efab14e37b1584fd32fefdd9a, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.368411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d890733-f284-40ac-ba92-55e5ec11894c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.379289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1103/2205] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:52 2022] PUT /identity/v3/projects/310af3bffa1d455b9eb21c7704d945e5/users/729a350efab14e37b1584fd32fefdd9a/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:52.389410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.389700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.389979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.415783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] MFA Rules not processed for user `729a350efab14e37b1584fd32fefdd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:52.417008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:52.421916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:52.487927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1104/2206] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:16:52.500868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.502293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:52.559418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1f45d-30ab-4836-8174-51315e79a44d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.563280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d332e-befd-47aa-9d40-09e3cbb72fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.564001 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d332e-befd-47aa-9d40-09e3cbb72fbe service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.564376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d332e-befd-47aa-9d40-09e3cbb72fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.564654 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d332e-befd-47aa-9d40-09e3cbb72fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.568441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bca01cd607845a581d41f0095a55d53'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:52.579143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:52.581455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bca01cd607845a581d41f0095a55d53'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:52.582482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bca01cd607845a581d41f0095a55d53'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:52.583143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bca01cd607845a581d41f0095a55d53'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:52.630141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d332e-befd-47aa-9d40-09e3cbb72fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.631661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d332e-befd-47aa-9d40-09e3cbb72fbe service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.640711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1105/2207] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:52.677484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bca01cd607845a581d41f0095a55d53'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:52.688527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1103/2208] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:16:52 2022] DELETE /identity/v3/users/1bca01cd607845a581d41f0095a55d53 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:16:52.693179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.693476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.693756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.711879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:52.712930 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:52.767214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:52.777812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1106/2209] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:52.796000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:52.797563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:52.858096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797230-4628-40d9-871e-5f46f98cd569 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:52.861752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b94151-15d8-4c9b-85f6-ddbfdc91157f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:52.862803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94151-15d8-4c9b-85f6-ddbfdc91157f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:52.863087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94151-15d8-4c9b-85f6-ddbfdc91157f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:52.863364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94151-15d8-4c9b-85f6-ddbfdc91157f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:52.875837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b94151-15d8-4c9b-85f6-ddbfdc91157f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:52.875837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b94151-15d8-4c9b-85f6-ddbfdc91157f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:52.885924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1104/2210] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:53.396557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:53.398306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:53.410333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdcdfa-e273-49eb-bb82-668454ad4156 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:53.415822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:53.416739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:53.417026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:53.417306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] PATH_INFO: `/v3/projects/e08cc9ff39e34289add6298f9b6c81cc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:53.418557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08cc9ff39e34289add6298f9b6c81cc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:53.420625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:53.531634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08cc9ff39e34289add6298f9b6c81cc', 'request_id': 'req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:53.537905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08cc9ff39e34289add6298f9b6c81cc', 'request_id': 'req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:53.543295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08cc9ff39e34289add6298f9b6c81cc', 'request_id': 'req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:53.618000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] The token cache is being invalidate because project e08cc9ff39e34289add6298f9b6c81cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:16:53.618292 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:53.618933 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6e79533-290b-4d5f-88f6-f4dc4d95f9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:16:53.620601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1107/2211] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:16:53 2022] DELETE /identity/v3/projects/e08cc9ff39e34289add6298f9b6c81cc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:53.625338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:53.625827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:53.625947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:53.644008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:53.645194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:53.703446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1105/2212] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:53.711679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:53.712024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:53.712310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:53.731029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:53.732255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:53.740071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1108/2213] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:53.744943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:53.754519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d5f98-a397-4db0-94b6-3c6de1780f45 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:53.759194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:53.759889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:53.760177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:53.760454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:53.761171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:16:53.761477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:53.763075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:53.774567 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1106/2214] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:16:53.778871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:53.788631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061ec6-c205-4278-aa8a-b69b3471609e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:53.793319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:53.793963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:53.794244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:53.794588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:53.795207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:53.797148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:53.882742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1109/2215] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:16:53 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:53.886605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:53.896629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88619-0135-47f0-9fb8-404941a928c1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:53.951943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:53.952606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:53.953360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:53.953360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:53.953860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:53.955820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:54.035724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:54.042189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1107/2216] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:16:53 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:16:54.046369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:54.057091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d01c9f-1516-49c5-b5d4-566143dd4706 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:54.061708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:54.062367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:54.062677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:54.062952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:54.063713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:54.065349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:54.075867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1110/2217] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:54.079737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:54.090454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023221c-c663-430a-abd2-ed7c9a74a5d2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:54.094995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370afc5b-d43a-4e1b-ac82-4e71662445ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:54.095644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370afc5b-d43a-4e1b-ac82-4e71662445ee admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:54.095963 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370afc5b-d43a-4e1b-ac82-4e71662445ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:54.096242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370afc5b-d43a-4e1b-ac82-4e71662445ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:54.096966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370afc5b-d43a-4e1b-ac82-4e71662445ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:54.098558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370afc5b-d43a-4e1b-ac82-4e71662445ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:54.110286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1108/2218] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:16:54.120121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:54.130294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639be082-4f20-41f3-b076-6126e374fac1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:54.135659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:54.136574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:54.136861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:54.137253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] PATH_INFO: `/v3/projects/9a065f21900943bc8cc9b0e20e0c2438/users/042d1d8fd1174df581c464239dc7f36e/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:54.151874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a065f21900943bc8cc9b0e20e0c2438, user_id=042d1d8fd1174df581c464239dc7f36e, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:54.154584 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:54.217866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1111/2219] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:16:54 2022] PUT /identity/v3/projects/9a065f21900943bc8cc9b0e20e0c2438/users/042d1d8fd1174df581c464239dc7f36e/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:16:54.223117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c451e9-56f5-4266-a7f2-03d0e9f45a59 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:54.223406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c451e9-56f5-4266-a7f2-03d0e9f45a59 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:54.223682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c451e9-56f5-4266-a7f2-03d0e9f45a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:54.247689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-46c451e9-56f5-4266-a7f2-03d0e9f45a59 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:54.247689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-46c451e9-56f5-4266-a7f2-03d0e9f45a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:54.301949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1109/2220] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:54.313257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:54.314969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:54.405092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a2792-bd4b-4282-928d-d5347e5d2207 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:54.408728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:54.409449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:54.409827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:54.410175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:54.420606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:54.422158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:54.432996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1112/2221] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:55.623414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:55.625692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:55.626000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:55.672863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] MFA Rules not processed for user `042d1d8fd1174df581c464239dc7f36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:55.681027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:55.768150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1110/2222] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:16:55.779624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:55.784213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:55.807030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:55.850332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d533908-f16e-4e84-bf35-78d006d3ff97 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:55.854646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70bf0-ac59-4695-aed3-ec609b858321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:55.855311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70bf0-ac59-4695-aed3-ec609b858321 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:55.855599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70bf0-ac59-4695-aed3-ec609b858321 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:55.855896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70bf0-ac59-4695-aed3-ec609b858321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:55.866238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70bf0-ac59-4695-aed3-ec609b858321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:55.876442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70bf0-ac59-4695-aed3-ec609b858321 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:55.890397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1113/2223] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:16:57.130625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:16:57.143128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959dd51-0b75-4443-8476-f8fb8daf3767 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:16:57.146821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:16:57.147470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:57.147752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:57.148057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:57.149916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:57.216936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:16:57.218445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:16:57.229708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1111/2224] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:16:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:16:59.310788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d1a7-3f36-403e-b9ea-29cde66c987a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:16:59.315474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d1a7-3f36-403e-b9ea-29cde66c987a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:16:59.315474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d1a7-3f36-403e-b9ea-29cde66c987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:16:59.330866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-05a2d1a7-3f36-403e-b9ea-29cde66c987a None None] MFA Rules not processed for user `06e9e172155548289ca938421d4e32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:16:59.332356 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-05a2d1a7-3f36-403e-b9ea-29cde66c987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:16:59.388490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1114/2225] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:00.572077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:00.580665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84375d0-a3ce-4b93-8d0a-e233fa0c8ed8 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:00.585273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:00.586301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:00.586587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:00.586700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:00.588780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:00.605512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:00.676710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:00.678180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:00.688116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1112/2226] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:01.021043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef84ea-1f7a-4027-b5ea-bd840f49beb0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:01.021578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef84ea-1f7a-4027-b5ea-bd840f49beb0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:01.021693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef84ea-1f7a-4027-b5ea-bd840f49beb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:01.040218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-12ef84ea-1f7a-4027-b5ea-bd840f49beb0 None None] MFA Rules not processed for user `042d1d8fd1174df581c464239dc7f36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:01.041428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12ef84ea-1f7a-4027-b5ea-bd840f49beb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:01.048461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1115/2227] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:07.656258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:07.660959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:07.673967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9eb643-c693-47bb-a983-a1706da72ac4 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:07.684167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:07.685197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:07.685553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:07.685984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] PATH_INFO: `/v3/users/0a3244455cdc49b39f07837a30dec86a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:07.687354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3244455cdc49b39f07837a30dec86a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:07.689702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:07.902505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3244455cdc49b39f07837a30dec86a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:07.940427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3244455cdc49b39f07837a30dec86a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:07.945482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3244455cdc49b39f07837a30dec86a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:07.947667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3244455cdc49b39f07837a30dec86a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:08.025754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3244455cdc49b39f07837a30dec86a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:08.050115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1113/2228] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:07 2022] DELETE /identity/v3/users/0a3244455cdc49b39f07837a30dec86a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:08.051708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:08.052224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:08.052420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:08.081280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:08.083607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:08.177205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1116/2229] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:17:08.185817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:08.187640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:08.284008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d716bd3-7948-470e-bdc9-fc92eceb0006 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:08.287833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:08.289326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:08.289802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:08.290039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:08.301298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:08.302636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:08.315401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1114/2230] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:17:09.099816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:09.101867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:09.113956 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c16d84-fee6-482f-827a-5895a35e12bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:09.123381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:09.123381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:09.123381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:09.127217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] PATH_INFO: `/v3/projects/e4c47dbf60e148c3a23328a4882a3aba` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:09.127217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c47dbf60e148c3a23328a4882a3aba)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:09.128002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:09.260369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c47dbf60e148c3a23328a4882a3aba', 'request_id': 'req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.271341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c47dbf60e148c3a23328a4882a3aba', 'request_id': 'req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.274896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:09.279206 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c47dbf60e148c3a23328a4882a3aba', 'request_id': 'req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.382985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] The token cache is being invalidate because project e4c47dbf60e148c3a23328a4882a3aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:09.384799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.388114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.390722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1117/2231] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:09 2022] DELETE /identity/v3/projects/e4c47dbf60e148c3a23328a4882a3aba => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:09.394666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:09.405227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca293c9-a5ad-4208-806b-0dd3fc587cd9 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:09.462243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:09.527698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:09.528639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:09.529114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:09.529383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] PATH_INFO: `/v3/users/decc646464f845e6aec8877d66a2b8dc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:09.531078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decc646464f845e6aec8877d66a2b8dc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:09.533359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:09.750814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decc646464f845e6aec8877d66a2b8dc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.770520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decc646464f845e6aec8877d66a2b8dc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.771384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decc646464f845e6aec8877d66a2b8dc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.772097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decc646464f845e6aec8877d66a2b8dc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.851861 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decc646464f845e6aec8877d66a2b8dc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:09.868396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1115/2232] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:09 2022] DELETE /identity/v3/users/decc646464f845e6aec8877d66a2b8dc => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:10.584261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:10.586538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:10.615610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e64e-2a11-496a-85ca-7f4696dde9fa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:10.720947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:10.722232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:10.722925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:10.724469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] PATH_INFO: `/v3/projects/88bb0113e7af4b2899ac0022b057ac81` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:10.730829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bb0113e7af4b2899ac0022b057ac81)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:10.733095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:10.881114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bb0113e7af4b2899ac0022b057ac81', 'request_id': 'req-5762017b-0f6e-4cdc-8243-db6de8a40051'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:10.889549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bb0113e7af4b2899ac0022b057ac81', 'request_id': 'req-5762017b-0f6e-4cdc-8243-db6de8a40051'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:10.897355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bb0113e7af4b2899ac0022b057ac81', 'request_id': 'req-5762017b-0f6e-4cdc-8243-db6de8a40051'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.012109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:11.013561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:11.027549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ca439-0c0c-43a3-a01d-58448112a556 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:11.031172 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] The token cache is being invalidate because project 88bb0113e7af4b2899ac0022b057ac81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:11.031471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.034328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.034328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1118/2233] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:10 2022] DELETE /identity/v3/projects/88bb0113e7af4b2899ac0022b057ac81 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:11.037577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:11.038965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:11.089099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:11.090008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:11.091618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:11.091618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] PATH_INFO: `/v3/users/dea29a620c094ac6b5e90ae8bc8b7908` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:11.093476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea29a620c094ac6b5e90ae8bc8b7908)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:11.095447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:11.107515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762017b-0f6e-4cdc-8243-db6de8a40051 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:11.112262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:11.113142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:11.113457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:11.113736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] PATH_INFO: `/v3/users/729a350efab14e37b1584fd32fefdd9a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:11.114926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729a350efab14e37b1584fd32fefdd9a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:11.117287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:11.136105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:11.324878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729a350efab14e37b1584fd32fefdd9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.332633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:11.334956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea29a620c094ac6b5e90ae8bc8b7908'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.341637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729a350efab14e37b1584fd32fefdd9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.342414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729a350efab14e37b1584fd32fefdd9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.348702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea29a620c094ac6b5e90ae8bc8b7908'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.349514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea29a620c094ac6b5e90ae8bc8b7908'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.350129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea29a620c094ac6b5e90ae8bc8b7908'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.418275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729a350efab14e37b1584fd32fefdd9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.418957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6e5dcd49-6eee-41fc-ba9a-b9dc5f9786c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729a350efab14e37b1584fd32fefdd9a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.432651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1119/2234] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:11 2022] DELETE /identity/v3/users/729a350efab14e37b1584fd32fefdd9a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:17:11.486618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea29a620c094ac6b5e90ae8bc8b7908'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:11.499600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1116/2235] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:11 2022] DELETE /identity/v3/users/dea29a620c094ac6b5e90ae8bc8b7908 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:17:11.504077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:11.504396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:11.504678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:11.523438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:11.524674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:11.584864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1120/2236] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:11.597269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:11.598708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:11.656641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056db6f-dc31-4f19-83f5-a64966bafed6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:11.660203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf34fd-0b28-4398-8f96-538b98fb92c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:11.660875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf34fd-0b28-4398-8f96-538b98fb92c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:11.661159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf34fd-0b28-4398-8f96-538b98fb92c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:11.661436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf34fd-0b28-4398-8f96-538b98fb92c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:11.670845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf34fd-0b28-4398-8f96-538b98fb92c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:11.672289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf34fd-0b28-4398-8f96-538b98fb92c1 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:11.681697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1117/2237] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:11.972963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:11.974757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:11.988601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a6d39-0f67-4595-9bef-40866a6cbf1d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:11.994186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:11.995337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:11.995624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:11.995950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] PATH_INFO: `/v3/projects/310af3bffa1d455b9eb21c7704d945e5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:11.997216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=310af3bffa1d455b9eb21c7704d945e5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:11.999424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.163992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310af3bffa1d455b9eb21c7704d945e5', 'request_id': 'req-85a31e25-a933-4300-9e6e-81e22adce7bb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.170651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310af3bffa1d455b9eb21c7704d945e5', 'request_id': 'req-85a31e25-a933-4300-9e6e-81e22adce7bb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.176227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310af3bffa1d455b9eb21c7704d945e5', 'request_id': 'req-85a31e25-a933-4300-9e6e-81e22adce7bb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.284753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] The token cache is being invalidate because project 310af3bffa1d455b9eb21c7704d945e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:12.285044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.290520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-85a31e25-a933-4300-9e6e-81e22adce7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.290520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1121/2238] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:11 2022] DELETE /identity/v3/projects/310af3bffa1d455b9eb21c7704d945e5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:12.292353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.292828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.292828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.312336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:12.313546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:12.397684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1118/2239] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:12.400034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.405010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.405010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.427299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:12.435954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:12.459167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1122/2240] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:17:12.463888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.475210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a86a22-78d7-496c-b208-99fe1a657ffa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.480626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.481427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.481716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.482219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.483216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:17:12.483688 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:12.485363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.497906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1119/2241] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:17:12.502648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.512743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ab549-6b08-46a0-8b97-5bb17d4635e6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.517829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.518535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.518822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.519249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.520030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:12.521922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.532516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:12.636803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.638638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:12.642037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1123/2242] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:17:12 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:12.643063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.654655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980be12-8ac2-4c20-bee2-285f3b4557ac admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.711030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e6662-825b-415e-a6a8-724f65460cae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.715173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.715929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.716062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.716341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.716591 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.716692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] PATH_INFO: `/v3/projects/f66c655b19c44bc9945381507a21109c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.716873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.717177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.717791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66c655b19c44bc9945381507a21109c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:12.718137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:12.719718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.720096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.728335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:12.836020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1124/2243] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:17:12 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:17:12.840018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.849878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a116b9-9ee8-4d98-9c78-f8f3b9ea890f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.856834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.857613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.868968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.868968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.868968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:12.868968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.871558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1125/2244] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:12.875075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66c655b19c44bc9945381507a21109c', 'request_id': 'req-d9120e3b-42a2-4e77-8208-b338dd4cbb05'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.875507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.886049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d6d9-8b76-486e-aa72-5723f2d81943 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.927958 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66c655b19c44bc9945381507a21109c', 'request_id': 'req-d9120e3b-42a2-4e77-8208-b338dd4cbb05'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.935711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66c655b19c44bc9945381507a21109c', 'request_id': 'req-d9120e3b-42a2-4e77-8208-b338dd4cbb05'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.946167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07766576-b9cc-4e04-8520-fc2851dfcfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.946839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766576-b9cc-4e04-8520-fc2851dfcfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.947126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766576-b9cc-4e04-8520-fc2851dfcfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.947410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07766576-b9cc-4e04-8520-fc2851dfcfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:12.948183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07766576-b9cc-4e04-8520-fc2851dfcfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:12.949060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] The token cache is being invalidate because project f66c655b19c44bc9945381507a21109c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:12.949447 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.949782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07766576-b9cc-4e04-8520-fc2851dfcfa2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:12.950228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:12.952206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1120/2245] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:12 2022] DELETE /identity/v3/projects/f66c655b19c44bc9945381507a21109c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:12.961563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1126/2246] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:17:12.965654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:12.967138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:12.987622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9120e3b-42a2-4e77-8208-b338dd4cbb05 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:12.992951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:12.993954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:12.994376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:12.995627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] PATH_INFO: `/v3/projects/2ade307c566f4a30bf404d0970534ac3/users/2d2967c477684709b3e44f2ed7b25b32/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.014266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ade307c566f4a30bf404d0970534ac3, user_id=2d2967c477684709b3e44f2ed7b25b32, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.017016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:13.090498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1121/2247] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:17:12 2022] PUT /identity/v3/projects/2ade307c566f4a30bf404d0970534ac3/users/2d2967c477684709b3e44f2ed7b25b32/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:13.102205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.103733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.106667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.140714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] MFA Rules not processed for user `2d2967c477684709b3e44f2ed7b25b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:13.142718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:13.227840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1127/2248] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:17:13.232165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:13.308271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c14c33-cb14-4289-bd6d-3497e6af05c4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:13.313765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:13.314596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.318583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.318583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.318583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.318583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:13.419388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1122/2249] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:13.430408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:13.446776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d37c-e40e-4995-8fe0-71fd5d66800f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:13.509060 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:13.509753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.510042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.510351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.513420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.513420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:13.601341 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1128/2250] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:17:13 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:13.605537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:13.616026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba34cd7-2e0c-4f29-8e25-02a12869075e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:13.623506 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:13.624282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.624635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.624984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.625722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.627456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:13.640898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1123/2251] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:13.644988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:13.658750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1816eea-3fec-41d7-b884-51246bc44bb2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:13.665384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759e5b8-0872-4fa9-8b3e-a560c8c2f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:13.666597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e5b8-0872-4fa9-8b3e-a560c8c2f44a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.667219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e5b8-0872-4fa9-8b3e-a560c8c2f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.667741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e5b8-0872-4fa9-8b3e-a560c8c2f44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.668727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759e5b8-0872-4fa9-8b3e-a560c8c2f44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.670876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759e5b8-0872-4fa9-8b3e-a560c8c2f44a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:13.690355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1129/2252] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:13.695108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:13.705542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6812026-e2f5-4604-8f21-fd047c4e22d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:13.711068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:13.712069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.712382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.712663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] PATH_INFO: `/v3/projects/be4b218af1234368a7c19c67966b0d04/users/9f731dbf3cba4f64b7221d031a604373/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.727557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4b218af1234368a7c19c67966b0d04, user_id=9f731dbf3cba4f64b7221d031a604373, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.730540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:13.796512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1124/2253] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:17:13 2022] PUT /identity/v3/projects/be4b218af1234368a7c19c67966b0d04/users/9f731dbf3cba4f64b7221d031a604373/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:13.808601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a063a-63a7-4150-be71-b96d13311093 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.808894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a063a-63a7-4150-be71-b96d13311093 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.809176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a063a-63a7-4150-be71-b96d13311093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.837375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-888a063a-63a7-4150-be71-b96d13311093 None None] MFA Rules not processed for user `9f731dbf3cba4f64b7221d031a604373`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:13.838769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-888a063a-63a7-4150-be71-b96d13311093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:13.902702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1130/2254] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:13.907363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:13.914029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:13.971345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45641e29-fb22-4ce8-93f3-79543a601454 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:13.977625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:13.978604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:13.978604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:13.978840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:13.979670 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:13.981635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.077988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1125/2255] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:17:13 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:14.079513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a063a-63a7-4150-be71-b96d13311093 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:14.093151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a063a-63a7-4150-be71-b96d13311093 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:14.152690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:14.153385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.153671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.153948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.154651 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:14.155581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:14.156628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.240686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1131/2256] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:17:14 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:17:14.244920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:14.256776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07585f07-cc19-4e40-bc09-e4ce9161c7b0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:14.261897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:14.263067 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.263491 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.263779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.264541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:14.266496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.282600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1126/2257] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:14.283820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:14.294399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716832ed-4918-4d40-a0cb-a36b21065522 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:14.299280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:14.300209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.300537 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.300825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] PATH_INFO: `/v3/projects/050b37216bea4ba3b524b9fd20c41d62/users/b6bbe48e28a7425da2ce47af1fb22ff1/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.318015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050b37216bea4ba3b524b9fd20c41d62, user_id=b6bbe48e28a7425da2ce47af1fb22ff1, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:14.321995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.422161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1132/2258] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:17:14 2022] PUT /identity/v3/projects/050b37216bea4ba3b524b9fd20c41d62/users/b6bbe48e28a7425da2ce47af1fb22ff1/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:17:14.426204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:14.437709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559192e1-ff00-4ddc-91d5-273eaba68029 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:14.504589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252f03-919a-4f19-aacd-fbf1d7aa8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:14.505308 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252f03-919a-4f19-aacd-fbf1d7aa8afe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.505599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252f03-919a-4f19-aacd-fbf1d7aa8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.505879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252f03-919a-4f19-aacd-fbf1d7aa8afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.506601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252f03-919a-4f19-aacd-fbf1d7aa8afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:14.509027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252f03-919a-4f19-aacd-fbf1d7aa8afe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.520177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1127/2259] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:17:14.524815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:14.535569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31805e20-a6c0-4142-8178-3e023947c6b9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:14.541241 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:14.542282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.542646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.542992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] PATH_INFO: `/v3/projects/050b37216bea4ba3b524b9fd20c41d62/users/b6bbe48e28a7425da2ce47af1fb22ff1/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.545675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=050b37216bea4ba3b524b9fd20c41d62, user_id=b6bbe48e28a7425da2ce47af1fb22ff1, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:14.548602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.560234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1133/2260] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:17:14 2022] PUT /identity/v3/projects/050b37216bea4ba3b524b9fd20c41d62/users/b6bbe48e28a7425da2ce47af1fb22ff1/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:14.570748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.571060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.571346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.602290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] MFA Rules not processed for user `b6bbe48e28a7425da2ce47af1fb22ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:14.603497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:14.682346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1128/2261] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:14.698136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:14.699974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:14.759755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d35c40-0dbd-46b3-88e5-3c8765176ccf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:14.763587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070408e-1c07-4aaf-92b7-26097d86f23c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:14.764285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070408e-1c07-4aaf-92b7-26097d86f23c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:14.764564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070408e-1c07-4aaf-92b7-26097d86f23c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:14.764837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070408e-1c07-4aaf-92b7-26097d86f23c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:14.821795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070408e-1c07-4aaf-92b7-26097d86f23c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:14.823432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070408e-1c07-4aaf-92b7-26097d86f23c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:14.844010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1134/2262] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:14.847780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:16.406071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:16.407499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:16.414417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:16.473761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f05be-f9f8-4beb-b1d8-dead5aca0f34 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:16.478572 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:16.479592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:16.479933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:16.480240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] PATH_INFO: `/v3/users/8e521f65a3444932a9fd7ee95be8cf8a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:16.481411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e521f65a3444932a9fd7ee95be8cf8a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:16.483368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:16.664690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e521f65a3444932a9fd7ee95be8cf8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:16.676950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e521f65a3444932a9fd7ee95be8cf8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:16.677649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e521f65a3444932a9fd7ee95be8cf8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:16.678263 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e521f65a3444932a9fd7ee95be8cf8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:16.766258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e521f65a3444932a9fd7ee95be8cf8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:16.779987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1129/2263] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:16 2022] DELETE /identity/v3/users/8e521f65a3444932a9fd7ee95be8cf8a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:16.784466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:16.784920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:16.785183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:16.802101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:16.803402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:16.906111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1135/2264] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:16.924315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:16.932957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:16.975860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:16.977792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:16.996962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9bd7-3510-4ef3-9245-e36faf0660a1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:17.001156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:17.002003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:17.002454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:17.002735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:17.004894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:17.015269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:17.016901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:17.028768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1130/2265] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:17.062098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506c142-1c8d-43fd-8a26-3ce73c133625 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:17.066707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:17.067544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:17.068518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:17.068805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:17.071477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:17.154685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:17.156610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f25ec7-5095-4866-8ff7-c2c247252e99 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:17.176714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1136/2266] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:17:17.504302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:17.506214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:17.525699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707214f-7d91-4be3-b02e-2401dac312c4 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:17.550739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:17.552633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:17.553252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:17.553700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] PATH_INFO: `/v3/projects/aad279f327e44c9ebcf8c467a238059b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:17.556016 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad279f327e44c9ebcf8c467a238059b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:17.558360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:17.593405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:17.735345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad279f327e44c9ebcf8c467a238059b', 'request_id': 'req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:17.857584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad279f327e44c9ebcf8c467a238059b', 'request_id': 'req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:17.864438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad279f327e44c9ebcf8c467a238059b', 'request_id': 'req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:17.875350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] The token cache is being invalidate because project aad279f327e44c9ebcf8c467a238059b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:17.875639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:17.876402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4fbe6f03-65e0-4b4d-92b8-48802c2114d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:17.877935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1131/2267] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:17 2022] DELETE /identity/v3/projects/aad279f327e44c9ebcf8c467a238059b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:17.882890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:17.883339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:17.884491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:17.901792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:17.902994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:17.964192 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1137/2268] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:17.972123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:17.972482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:17.972765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:17.991003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:17.992534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:18.001902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1132/2269] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:18.013097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.022934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff6ab5-9eec-4482-a6c4-f380f9bef23a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.027655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.028316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.028601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.028880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.029607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:17:18.029918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.031551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.044031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1138/2270] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:17:18.048366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.058821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837cf6d-4010-4e1a-afb0-8239468c6917 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.063599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967853-743c-4685-b959-9927536a952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.064278 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967853-743c-4685-b959-9927536a952a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.064561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967853-743c-4685-b959-9927536a952a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.064835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967853-743c-4685-b959-9927536a952a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.065523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee967853-743c-4685-b959-9927536a952a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.067448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee967853-743c-4685-b959-9927536a952a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.185897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1133/2271] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:17:18 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:18.187769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.198558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80648c8-a373-4b49-b0fd-49a96db4edd0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.250392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:18.260616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.261297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.261588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.261914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.262628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.264598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.343529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1139/2272] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:17:18 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:18.347761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967853-743c-4685-b959-9927536a952a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.359456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967853-743c-4685-b959-9927536a952a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.364538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.365243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.365529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.365807 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.366537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.369352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.382546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1134/2273] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:18.386386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.405258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882439-1d18-4de9-be59-b9a3a77fa5d7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.410010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b2e32-5adb-480e-8c73-34ce8d750bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.410855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2e32-5adb-480e-8c73-34ce8d750bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.411146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2e32-5adb-480e-8c73-34ce8d750bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.411428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2e32-5adb-480e-8c73-34ce8d750bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.412194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b2e32-5adb-480e-8c73-34ce8d750bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.413798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b2e32-5adb-480e-8c73-34ce8d750bcd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.424764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1140/2274] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:17:18.428941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.440082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4e7c7-7845-40b5-93dd-3305c448f093 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.444912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.445798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.447222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.447222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] PATH_INFO: `/v3/projects/5cc2c0063a4443d2858152dd95bc074d/users/aa03c345613842c5a202aa30bc05b229/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.462386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc2c0063a4443d2858152dd95bc074d, user_id=aa03c345613842c5a202aa30bc05b229, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.465121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.547735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1135/2275] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:17:18 2022] PUT /identity/v3/projects/5cc2c0063a4443d2858152dd95bc074d/users/aa03c345613842c5a202aa30bc05b229/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:18.552947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.553240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.553521 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.572351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:18.573553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:18.632569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1141/2276] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:18.642105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.643769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:18.707350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf9ec-f4fd-40b6-bc13-69a96ff16589 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.711017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b2d6e-c8f3-495f-af53-0275e183b8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.712253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2d6e-c8f3-495f-af53-0275e183b8ec service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.712594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2d6e-c8f3-495f-af53-0275e183b8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.712798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b2d6e-c8f3-495f-af53-0275e183b8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.722279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b2d6e-c8f3-495f-af53-0275e183b8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.723729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b2d6e-c8f3-495f-af53-0275e183b8ec service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.734207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1136/2277] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:17:18.789386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:18.791185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:18.849676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7a425-c1fb-40a7-97e9-65af95dc742a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:18.853373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:18.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:18.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:18.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:18.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:18.928038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:18.929489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:18.940067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1142/2278] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:20.092032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40fc88-6f4f-44c1-8220-dd5eab04664b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:20.092032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40fc88-6f4f-44c1-8220-dd5eab04664b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:20.092032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40fc88-6f4f-44c1-8220-dd5eab04664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:20.116403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3f40fc88-6f4f-44c1-8220-dd5eab04664b None None] MFA Rules not processed for user `aa03c345613842c5a202aa30bc05b229`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:20.118143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3f40fc88-6f4f-44c1-8220-dd5eab04664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:20.158235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:20.186118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1137/2279] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:20.197716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:20.199260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:20.210804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f15cc-15b1-42b8-ae4c-21b932143a83 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:20.215011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:20.215682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:20.216085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:20.216668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:20.227776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:20.227776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:20.238534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1143/2280] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:17:23.035499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177525b-c6ae-4881-b601-5f20d45f7d29 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:23.035989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177525b-c6ae-4881-b601-5f20d45f7d29 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:23.036085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177525b-c6ae-4881-b601-5f20d45f7d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:23.053945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1177525b-c6ae-4881-b601-5f20d45f7d29 None None] MFA Rules not processed for user `aa03c345613842c5a202aa30bc05b229`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:23.055142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1177525b-c6ae-4881-b601-5f20d45f7d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:23.069440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1138/2281] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:24.991875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:24.993429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:25.010474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05842cb-54b0-4298-b71b-b1783ae157af service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:25.015159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:25.016062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:25.016344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:25.016768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] PATH_INFO: `/v3/users/2d2967c477684709b3e44f2ed7b25b32` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:25.018015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2967c477684709b3e44f2ed7b25b32)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:25.020014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:25.021859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:25.228007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2967c477684709b3e44f2ed7b25b32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:25.241825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2967c477684709b3e44f2ed7b25b32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:25.242822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2967c477684709b3e44f2ed7b25b32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:25.343171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2967c477684709b3e44f2ed7b25b32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:25.343824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2967c477684709b3e44f2ed7b25b32'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:25.357936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1144/2282] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:24 2022] DELETE /identity/v3/users/2d2967c477684709b3e44f2ed7b25b32 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:25.362445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:25.362986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:25.362986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:25.387169 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:25.388810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:25.457647 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1139/2283] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:25.467491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:25.469040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:25.536900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f91c-e83c-4b29-bed9-e15c89e6c5c0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:25.542854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:25.542854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:25.543239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:25.544405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:25.555470 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:25.560362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:25.568532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1145/2284] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:26.013899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:26.015351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:26.041342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fda0f-a43c-46e2-9b73-0c4925b45c2f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:26.048224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:26.048663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:26.049519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:26.050193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:26.050315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:26.051392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] PATH_INFO: `/v3/projects/2ade307c566f4a30bf404d0970534ac3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:26.052933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ade307c566f4a30bf404d0970534ac3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:26.058097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:26.143649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:26.146681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116618c3-8df8-424e-9b2f-33d8cd2afcca service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:26.153030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:26.155042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:26.155042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:26.155042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:26.156207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:26.168051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ade307c566f4a30bf404d0970534ac3', 'request_id': 'req-5cafebc2-9250-4dd9-b850-fe9c26a19100'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.172135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:26.173766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:26.183931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1146/2285] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:17:26.184746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:26.186085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:26.198178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beb890-905e-4c5d-8f57-06efaad8b1f2 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:26.230653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ade307c566f4a30bf404d0970534ac3', 'request_id': 'req-5cafebc2-9250-4dd9-b850-fe9c26a19100'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.241959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ade307c566f4a30bf404d0970534ac3', 'request_id': 'req-5cafebc2-9250-4dd9-b850-fe9c26a19100'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.252970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] The token cache is being invalidate because project 2ade307c566f4a30bf404d0970534ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:26.254865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.254865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.255980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1140/2286] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:26 2022] DELETE /identity/v3/projects/2ade307c566f4a30bf404d0970534ac3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:26.260059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:26.261877 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:26.263075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:26.263734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:26.264069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:26.264349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:26.266232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:26.280402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:26.281432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:26.292922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1147/2287] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:26.344015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:26.349391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cafebc2-9250-4dd9-b850-fe9c26a19100 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:26.354282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:26.355367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:26.355653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:26.355965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] PATH_INFO: `/v3/users/9f731dbf3cba4f64b7221d031a604373` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:26.357188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f731dbf3cba4f64b7221d031a604373)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:26.359188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:26.533681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f731dbf3cba4f64b7221d031a604373'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.546421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f731dbf3cba4f64b7221d031a604373'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.548545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f731dbf3cba4f64b7221d031a604373'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.548545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f731dbf3cba4f64b7221d031a604373'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.617090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f731dbf3cba4f64b7221d031a604373'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:26.631138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1141/2288] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:26 2022] DELETE /identity/v3/users/9f731dbf3cba4f64b7221d031a604373 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:17:27.006360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:27.017071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611c858-346a-4d49-98c5-a0f657a6154f service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:27.080003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:27.080877 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:27.081162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:27.081438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] PATH_INFO: `/v3/projects/be4b218af1234368a7c19c67966b0d04` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:27.082981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4b218af1234368a7c19c67966b0d04)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:27.084959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:27.235464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4b218af1234368a7c19c67966b0d04', 'request_id': 'req-dc543801-d568-4ea1-85f1-a8e34d7b11b2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.241738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4b218af1234368a7c19c67966b0d04', 'request_id': 'req-dc543801-d568-4ea1-85f1-a8e34d7b11b2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.247396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4b218af1234368a7c19c67966b0d04', 'request_id': 'req-dc543801-d568-4ea1-85f1-a8e34d7b11b2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.320773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] The token cache is being invalidate because project be4b218af1234368a7c19c67966b0d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:27.321067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.321692 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dc543801-d568-4ea1-85f1-a8e34d7b11b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.323817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1148/2289] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:27 2022] DELETE /identity/v3/projects/be4b218af1234368a7c19c67966b0d04 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:27.328006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:27.329375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:27.344833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6007ca-09df-48d7-ac5d-d180e4757af7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:27.403561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:27.404815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:27.405099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:27.405372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] PATH_INFO: `/v3/users/b6bbe48e28a7425da2ce47af1fb22ff1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:27.406600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bbe48e28a7425da2ce47af1fb22ff1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:27.408621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:27.472901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:27.473197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:27.473500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:27.493187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] MFA Rules not processed for user `042d1d8fd1174df581c464239dc7f36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:27.494585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:27.499850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:27.561170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1149/2290] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:17:27.705747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bbe48e28a7425da2ce47af1fb22ff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.722845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bbe48e28a7425da2ce47af1fb22ff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.724302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bbe48e28a7425da2ce47af1fb22ff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.725197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bbe48e28a7425da2ce47af1fb22ff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.818373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-884ca2fb-5016-4415-ba6b-0d751fd33609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bbe48e28a7425da2ce47af1fb22ff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:27.824360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:27.835843 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1142/2291] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:17:27 2022] DELETE /identity/v3/users/b6bbe48e28a7425da2ce47af1fb22ff1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:28.453994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:28.455522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:28.486352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36ba5b-a909-4973-8f7d-8707c32828db None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:28.552903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:28.553905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:28.554193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:28.554469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] PATH_INFO: `/v3/projects/050b37216bea4ba3b524b9fd20c41d62` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:28.555659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=050b37216bea4ba3b524b9fd20c41d62)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:28.557793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:28.683334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050b37216bea4ba3b524b9fd20c41d62', 'request_id': 'req-93dec939-885a-4d05-ae4a-7d933a363d8b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:28.689461 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050b37216bea4ba3b524b9fd20c41d62', 'request_id': 'req-93dec939-885a-4d05-ae4a-7d933a363d8b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:28.695416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050b37216bea4ba3b524b9fd20c41d62', 'request_id': 'req-93dec939-885a-4d05-ae4a-7d933a363d8b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:28.811383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] The token cache is being invalidate because project 050b37216bea4ba3b524b9fd20c41d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:17:28.811672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:28.812321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93dec939-885a-4d05-ae4a-7d933a363d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:17:28.813855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1150/2292] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:17:28 2022] DELETE /identity/v3/projects/050b37216bea4ba3b524b9fd20c41d62 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:28.818825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:28.819288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:28.819383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:28.838477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:28.839933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:28.902117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1143/2293] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:28.911023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:28.911312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:28.911589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:28.933024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:28.934285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:28.942629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1151/2294] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:28.950590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:28.964404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746d319-b8ea-406c-9eaf-dd3d248c477d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:28.973307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:28.974004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:28.974287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:28.974562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:28.975315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:17:28.975665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:28.977304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:28.991290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1144/2295] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:17:28.996181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:29.005404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90ca64-d15c-47c1-a830-f5be69949f82 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:29.010598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:29.011328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.011680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.012114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.012896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:29.014860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:29.084043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1152/2296] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:17:28 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:29.089485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:29.101477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ae87a-21eb-461b-9a32-79a38de748d5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:29.163264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:29.164086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.164302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.164589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.165327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:29.168954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:29.257240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1145/2297] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:17:29 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:17:29.261708 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:29.277653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb8599-6f06-4dc1-b4a0-c4b98c3201d3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:29.282696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:29.283377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.283665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.284007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.284806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:29.288254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:29.303311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1153/2298] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:29.306035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:29.317618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782d0e-b33c-43ae-8261-3fb5ebb24c22 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:29.323167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf56f6-dbcc-4149-a4e8-dabec4e92461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:29.323859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf56f6-dbcc-4149-a4e8-dabec4e92461 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.324145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf56f6-dbcc-4149-a4e8-dabec4e92461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.324417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf56f6-dbcc-4149-a4e8-dabec4e92461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.326161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf56f6-dbcc-4149-a4e8-dabec4e92461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:29.326769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf56f6-dbcc-4149-a4e8-dabec4e92461 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:29.345597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:29.346909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1146/2299] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:17:29.357985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784cc05-f398-4f13-bb23-3ce6118ad534 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:29.362500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:29.363395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.363685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.364020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] PATH_INFO: `/v3/projects/9350d9bafe544d4c8ee5584fa1af2dbc/users/2476a984621243469da5066d407c745a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.366748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:29.386006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9350d9bafe544d4c8ee5584fa1af2dbc, user_id=2476a984621243469da5066d407c745a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:29.389760 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:29.454967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1154/2300] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:17:29 2022] PUT /identity/v3/projects/9350d9bafe544d4c8ee5584fa1af2dbc/users/2476a984621243469da5066d407c745a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:17:29.468525 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b0e9-e3dd-4c5e-b00c-cf2904685ad9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.468824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b0e9-e3dd-4c5e-b00c-cf2904685ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.469108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451b0e9-e3dd-4c5e-b00c-cf2904685ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.500114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f451b0e9-e3dd-4c5e-b00c-cf2904685ad9 None None] MFA Rules not processed for user `2476a984621243469da5066d407c745a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:29.502812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f451b0e9-e3dd-4c5e-b00c-cf2904685ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:29.557254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:29.575381 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1147/2301] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:17:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:29.587227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:29.590008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:29.674775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55987d03-4569-44f0-82d6-92d27b8a341a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:29.678990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:29.680400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:29.680691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:29.680948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:29.691175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:29.692673 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:29.702024 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1155/2302] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:17:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:17:39.697688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:39.821530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:53.692261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:53.692865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:53.692865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:53.749327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:17:53.750508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:53.837400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1148/2303] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:17:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:17:53.880377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:17:53.881786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:17:53.975364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dda03-96fd-4bb0-ad43-fb4222618016 service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:17:53.984965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e82776-b12e-445d-a3d3-663aa171226c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:17:53.985748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82776-b12e-445d-a3d3-663aa171226c service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:17:53.986030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82776-b12e-445d-a3d3-663aa171226c service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:17:53.986564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82776-b12e-445d-a3d3-663aa171226c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:17:53.995304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e82776-b12e-445d-a3d3-663aa171226c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:17:53.997095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e82776-b12e-445d-a3d3-663aa171226c service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:17:54.006339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1156/2304] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:18:03.834373 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=47 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:04.002162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=41 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:05.747611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:05.831440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc5165-1a44-4a64-993f-ec15a2588696 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:05.836876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:05.837791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:05.838076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:05.838356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] PATH_INFO: `/v3/users/2476a984621243469da5066d407c745a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:05.839581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2476a984621243469da5066d407c745a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:05.841553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:06.047022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2476a984621243469da5066d407c745a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:06.065211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2476a984621243469da5066d407c745a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:06.066032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2476a984621243469da5066d407c745a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:06.066880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2476a984621243469da5066d407c745a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:06.131667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2476a984621243469da5066d407c745a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:06.159822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1149/2305] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:18:05 2022] DELETE /identity/v3/users/2476a984621243469da5066d407c745a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:06.164353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:06.164879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:06.164879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:06.185170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:06.186659 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:06.256883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1157/2306] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:06.267852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:06.269346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:06.353207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826fe0-e1f9-4ae6-87a4-16ecc14e44af admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:06.357114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575497c9-de08-48bd-95ab-6df32a2312f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:06.357775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575497c9-de08-48bd-95ab-6df32a2312f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:06.358195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575497c9-de08-48bd-95ab-6df32a2312f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:06.359089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575497c9-de08-48bd-95ab-6df32a2312f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:06.370307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575497c9-de08-48bd-95ab-6df32a2312f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:06.372302 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575497c9-de08-48bd-95ab-6df32a2312f2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:06.387986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1150/2307] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:18:06.858814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:06.860435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:06.880150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad1c89-ccce-4800-85e4-347cd925f4c6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:06.885960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:06.886831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:06.890858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:06.890858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] PATH_INFO: `/v3/projects/9350d9bafe544d4c8ee5584fa1af2dbc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:06.890858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9350d9bafe544d4c8ee5584fa1af2dbc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:06.892053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:07.045019 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9350d9bafe544d4c8ee5584fa1af2dbc', 'request_id': 'req-10c44174-9f63-4644-b5d8-69235746b83c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:07.054014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9350d9bafe544d4c8ee5584fa1af2dbc', 'request_id': 'req-10c44174-9f63-4644-b5d8-69235746b83c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:07.059854 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9350d9bafe544d4c8ee5584fa1af2dbc', 'request_id': 'req-10c44174-9f63-4644-b5d8-69235746b83c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:07.198476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] The token cache is being invalidate because project 9350d9bafe544d4c8ee5584fa1af2dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:18:07.199209 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:07.199639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:07.201829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1158/2308] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:18:06 2022] DELETE /identity/v3/projects/9350d9bafe544d4c8ee5584fa1af2dbc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:15.492409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053daf-e9b1-4e91-bdfa-2a6f61150c7b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:15.492872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053daf-e9b1-4e91-bdfa-2a6f61150c7b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:15.492970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37053daf-e9b1-4e91-bdfa-2a6f61150c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:15.512752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-37053daf-e9b1-4e91-bdfa-2a6f61150c7b None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:15.513975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-37053daf-e9b1-4e91-bdfa-2a6f61150c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:15.535172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:15.574138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1151/2309] 10.222.0.44 () {58 vars in 967 bytes} [Tue May 24 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:15.587745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:15.589252 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:15.667056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44174-9f63-4644-b5d8-69235746b83c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:15.672893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d235f-d330-481f-a1e7-a8b4b12ee941 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:15.673553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d235f-d330-481f-a1e7-a8b4b12ee941 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:15.673841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d235f-d330-481f-a1e7-a8b4b12ee941 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:15.674117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d235f-d330-481f-a1e7-a8b4b12ee941 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:15.682446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d235f-d330-481f-a1e7-a8b4b12ee941 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:15.684063 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d235f-d330-481f-a1e7-a8b4b12ee941 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:15.692323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1159/2310] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:18:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 10:18:18.930966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad325eb7-166b-44e6-81cb-e949a4f56a2d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:18.931501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad325eb7-166b-44e6-81cb-e949a4f56a2d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:18.931501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad325eb7-166b-44e6-81cb-e949a4f56a2d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:18.932951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1152/2311] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:18:18.943900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:18.944769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:18.945126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:18.970812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:18.992113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] MFA Rules not processed for user `6db55e0a3baa4da1b2e1eba24a6a7e12`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:18.993340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:19.059940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1160/2312] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:18:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:19.077695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad325eb7-166b-44e6-81cb-e949a4f56a2d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:19.079640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad325eb7-166b-44e6-81cb-e949a4f56a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:19.088782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:19.090842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:19.105719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad325eb7-166b-44e6-81cb-e949a4f56a2d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:19.117955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:19.118941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:19.119948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:19.120464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:19.133076 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:19.135128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:19.149657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1153/2313] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:18:19.183835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1493b-76f5-4bd2-990f-ad350c4222bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:19.189436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:19.190646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:19.191300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:19.193150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] PATH_INFO: `/v3/users/042d1d8fd1174df581c464239dc7f36e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:19.196713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=042d1d8fd1174df581c464239dc7f36e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:19.200574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:19.390885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042d1d8fd1174df581c464239dc7f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:19.404424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042d1d8fd1174df581c464239dc7f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:19.405182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042d1d8fd1174df581c464239dc7f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:19.502674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042d1d8fd1174df581c464239dc7f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:19.503338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6631e056-071a-45f0-afdc-4ebcd87477bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042d1d8fd1174df581c464239dc7f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:19.517044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1161/2314] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:18:19 2022] DELETE /identity/v3/users/042d1d8fd1174df581c464239dc7f36e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:18:19.870450 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:19.883370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b1883-b485-4337-951e-bb9f95551ec5 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:19.942825 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:19.943678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:19.943989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:19.944265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] PATH_INFO: `/v3/projects/9a065f21900943bc8cc9b0e20e0c2438` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:19.945425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a065f21900943bc8cc9b0e20e0c2438)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:19.947339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.056614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a065f21900943bc8cc9b0e20e0c2438', 'request_id': 'req-b2627323-4df8-493f-afcc-0de1f17ec279'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:20.140328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a065f21900943bc8cc9b0e20e0c2438', 'request_id': 'req-b2627323-4df8-493f-afcc-0de1f17ec279'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:20.146626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a065f21900943bc8cc9b0e20e0c2438', 'request_id': 'req-b2627323-4df8-493f-afcc-0de1f17ec279'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:20.157534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] The token cache is being invalidate because project 9a065f21900943bc8cc9b0e20e0c2438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:18:20.157823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:20.158472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2627323-4df8-493f-afcc-0de1f17ec279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:20.160114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1154/2315] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:18:19 2022] DELETE /identity/v3/projects/9a065f21900943bc8cc9b0e20e0c2438 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:20.164884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.165348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.165462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.183382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:20.184600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:20.194079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:20.244409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1162/2316] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:20.252434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.252832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.253209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.272429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:20.274268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:20.282357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1155/2317] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:20.286508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.296272 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01e0a3-a81a-491b-90a0-4c7e5970d87a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:20.300836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:20.302993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.302993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.302993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.302993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:18:20.303368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:20.304860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.316668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1163/2318] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:18:20.320874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.330476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a01753-a4b2-4a2a-931a-382f3fffede2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:20.335485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:20.336175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.336458 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.336734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.337438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:20.339339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.430255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1156/2319] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:18:20 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:18:20.434352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.445229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bbbab-e0e8-4ece-91cf-f32204a64508 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:20.504478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:20.505155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.505446 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.505726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.506434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:20.508378 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.615775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1164/2320] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:18:20 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:18:20.619913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.631426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f51e13-92e0-478a-a59c-7efea2e951fd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:20.636042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:20.636762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.637043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.637317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.638036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:20.639630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.654049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1157/2321] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:18:20.655493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.665974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f16974-f989-495d-ad10-446b987af7ab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:20.670646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77796c1-aaa9-4a22-bf66-60dff1972b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:20.671339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77796c1-aaa9-4a22-bf66-60dff1972b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.671656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77796c1-aaa9-4a22-bf66-60dff1972b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.671962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77796c1-aaa9-4a22-bf66-60dff1972b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.672690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77796c1-aaa9-4a22-bf66-60dff1972b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:20.674287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77796c1-aaa9-4a22-bf66-60dff1972b38 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.684191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1165/2322] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:18:20.688955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.695352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:20.698952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f210d90-8ddb-46d4-811c-f16370008b3c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:20.704638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:20.705502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.705782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.706055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] PATH_INFO: `/v3/projects/3abbe12f2c0d4f59bcb9465aa39d1baa/users/8837452ba1ce486b9190499538bb7fc5/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.720389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abbe12f2c0d4f59bcb9465aa39d1baa, user_id=8837452ba1ce486b9190499538bb7fc5, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:20.723010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:20.816509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1158/2323] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:18:20 2022] PUT /identity/v3/projects/3abbe12f2c0d4f59bcb9465aa39d1baa/users/8837452ba1ce486b9190499538bb7fc5/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:20.826431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:20.826728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:20.827015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:20.855698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] MFA Rules not processed for user `8837452ba1ce486b9190499538bb7fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:20.856947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:20.929098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1166/2324] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:20.938510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:20.940275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:20.999084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72449fa8-e920-44aa-ade2-f60d01a4260f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:21.003351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63137035-b4a5-4322-b874-e4ce0fe5ba20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:21.004047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63137035-b4a5-4322-b874-e4ce0fe5ba20 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:21.004331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63137035-b4a5-4322-b874-e4ce0fe5ba20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:21.005050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63137035-b4a5-4322-b874-e4ce0fe5ba20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:21.014100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63137035-b4a5-4322-b874-e4ce0fe5ba20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:21.016186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63137035-b4a5-4322-b874-e4ce0fe5ba20 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:21.026988 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1159/2325] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:18:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:18:21.053872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:21.072205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:21.128717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc180751-cec6-418e-b56c-99a27b6abd68 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:21.133279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:21.134152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:21.134438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:21.134718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] PATH_INFO: `/v3/users/8837452ba1ce486b9190499538bb7fc5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:21.135941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8837452ba1ce486b9190499538bb7fc5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:21.137886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:21.273832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8837452ba1ce486b9190499538bb7fc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:21.286479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8837452ba1ce486b9190499538bb7fc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:21.289939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8837452ba1ce486b9190499538bb7fc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:21.359650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8837452ba1ce486b9190499538bb7fc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:21.360303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8837452ba1ce486b9190499538bb7fc5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:21.372884 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1167/2326] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:18:21 2022] DELETE /identity/v3/users/8837452ba1ce486b9190499538bb7fc5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:21.378043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:21.378338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:21.378620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:21.396833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:21.398051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:21.462764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1160/2327] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:21.472849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:21.474345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:21.533385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfb085-7d0f-43ce-a61d-b278ceede154 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:21.536875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815ae15-c19f-444e-8cec-ea74e3f33817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:21.537556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815ae15-c19f-444e-8cec-ea74e3f33817 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:21.537958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815ae15-c19f-444e-8cec-ea74e3f33817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:21.538238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815ae15-c19f-444e-8cec-ea74e3f33817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:21.548119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815ae15-c19f-444e-8cec-ea74e3f33817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:21.549679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815ae15-c19f-444e-8cec-ea74e3f33817 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:21.559586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1168/2328] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:18:21.999865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.001523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:22.016081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499c48f-3f8f-4cb2-8d90-c6b81383c29f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.020891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.022189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.022573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.023108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] PATH_INFO: `/v3/projects/3abbe12f2c0d4f59bcb9465aa39d1baa` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.024520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abbe12f2c0d4f59bcb9465aa39d1baa)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.026913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.153702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abbe12f2c0d4f59bcb9465aa39d1baa', 'request_id': 'req-183ddf4e-d53d-4e00-9347-2cbeba1a434a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:22.228324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abbe12f2c0d4f59bcb9465aa39d1baa', 'request_id': 'req-183ddf4e-d53d-4e00-9347-2cbeba1a434a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:22.236693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abbe12f2c0d4f59bcb9465aa39d1baa', 'request_id': 'req-183ddf4e-d53d-4e00-9347-2cbeba1a434a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:22.256786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] The token cache is being invalidate because project 3abbe12f2c0d4f59bcb9465aa39d1baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:18:22.257209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:22.258556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-183ddf4e-d53d-4e00-9347-2cbeba1a434a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:18:22.260798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1161/2329] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:18:21 2022] DELETE /identity/v3/projects/3abbe12f2c0d4f59bcb9465aa39d1baa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:22.268153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.268902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.268902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.288963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:22.290484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:22.323863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:22.355981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1169/2330] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:22.364821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.365115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.365393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.379776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:22.386927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:22.391740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:22.397560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1162/2331] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:22.401875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.412670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b083d-2a18-4496-928d-8a2ee813dcf0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.421434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.424065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.424065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.424065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.424065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:18:22.424535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.426075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.446968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1170/2332] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:18:22.447529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.460660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52228d2f-aa1d-4c72-89bd-500d13f906ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.465643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.466301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.466713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.472251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.472251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.472251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.556239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1163/2333] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:18:22 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:18:22.558199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.569382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3f86c-cceb-4e93-9912-b0fbe7ad1c07 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.637375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.638351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.638740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.644124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.644124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.644124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.754517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.755550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1171/2334] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:18:22 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:18:22.766331 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31d07-4faf-496b-9841-e925581aa00f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.781508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.782674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.782674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.783119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.783983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.788208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.810789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1164/2335] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:18:22.815549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.838841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d6df-2b13-4990-9f71-cb75f0de0dc7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.846407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154f19-d677-482e-8095-533ae341aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.847362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154f19-d677-482e-8095-533ae341aa46 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.847830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154f19-d677-482e-8095-533ae341aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.848274 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154f19-d677-482e-8095-533ae341aa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.849629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154f19-d677-482e-8095-533ae341aa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.851616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154f19-d677-482e-8095-533ae341aa46 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.866792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1172/2336] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:18:22.870504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:22.881053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ca4bc-33d1-4429-84a0-ac75ad037e09 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:22.886335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:22.888218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:22.888218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:22.888218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] PATH_INFO: `/v3/projects/87e26b35daa3412db248234ca5709b28/users/1c4272b3e96046448437bd4a4d9a66db/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:22.908167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e26b35daa3412db248234ca5709b28, user_id=1c4272b3e96046448437bd4a4d9a66db, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:22.911045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:22.999305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1165/2337] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:18:22 2022] PUT /identity/v3/projects/87e26b35daa3412db248234ca5709b28/users/1c4272b3e96046448437bd4a4d9a66db/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:18:23.009510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eae29-7a71-4aa5-836e-9c1a6f94e805 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:23.010503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eae29-7a71-4aa5-836e-9c1a6f94e805 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:23.010503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eae29-7a71-4aa5-836e-9c1a6f94e805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:23.038903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-219eae29-7a71-4aa5-836e-9c1a6f94e805 None None] MFA Rules not processed for user `1c4272b3e96046448437bd4a4d9a66db`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:23.040288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-219eae29-7a71-4aa5-836e-9c1a6f94e805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:23.119631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1173/2338] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:18:23.128127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:23.130122 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:23.197300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b8054-77ca-40d7-a704-f6f114ff3851 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:23.201121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d979c4-2516-4f5b-9b8e-b5123cc64277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:23.201774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d979c4-2516-4f5b-9b8e-b5123cc64277 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:23.202059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d979c4-2516-4f5b-9b8e-b5123cc64277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:23.203150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d979c4-2516-4f5b-9b8e-b5123cc64277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:23.212566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d979c4-2516-4f5b-9b8e-b5123cc64277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:23.214370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d979c4-2516-4f5b-9b8e-b5123cc64277 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:23.224426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1166/2339] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:18:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:18:24.912474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9d1f-ded7-4d47-80b9-a4811aa52514 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:24.912990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9d1f-ded7-4d47-80b9-a4811aa52514 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:24.913086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9d1f-ded7-4d47-80b9-a4811aa52514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:24.933685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a3ea9d1f-ded7-4d47-80b9-a4811aa52514 None None] MFA Rules not processed for user `1c4272b3e96046448437bd4a4d9a66db`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:24.934925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3ea9d1f-ded7-4d47-80b9-a4811aa52514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:24.943575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1174/2340] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:33.220427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:34.927652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:43.944104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427b9e7-5cfd-4fb7-ba71-fe9e7761d2dc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:43.944565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427b9e7-5cfd-4fb7-ba71-fe9e7761d2dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:43.944810 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427b9e7-5cfd-4fb7-ba71-fe9e7761d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:43.963973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1427b9e7-5cfd-4fb7-ba71-fe9e7761d2dc None None] MFA Rules not processed for user `06e9e172155548289ca938421d4e32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:43.965226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1427b9e7-5cfd-4fb7-ba71-fe9e7761d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:44.021034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1167/2341] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:51.660003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:51.660490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:51.660585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:51.678325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] MFA Rules not processed for user `04058cb7cf374eba92fb7ee796084e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:51.679487 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:51.733214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1175/2342] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:18:54.013235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:59.031850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c7c0-455f-4d37-a03f-09911afb88ad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:59.032727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c7c0-455f-4d37-a03f-09911afb88ad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:59.032727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c7c0-455f-4d37-a03f-09911afb88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:59.050197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d5d8c7c0-455f-4d37-a03f-09911afb88ad None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:18:59.051386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d5d8c7c0-455f-4d37-a03f-09911afb88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:59.109405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1168/2343] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:18:59.131373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:18:59.132808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:18:59.204995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af249af5-b72e-4224-8acd-e0586fcdca2b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:18:59.211903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:18:59.212564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:18:59.212846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:18:59.213306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:18:59.223093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:18:59.224936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:18:59.234161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1176/2344] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:18:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:19:00.329708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d341b-6e9c-4b82-a88b-ba4f746b6b89 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:00.330160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d341b-6e9c-4b82-a88b-ba4f746b6b89 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:00.330282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d341b-6e9c-4b82-a88b-ba4f746b6b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:00.348596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dd5d341b-6e9c-4b82-a88b-ba4f746b6b89 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:19:00.349781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dd5d341b-6e9c-4b82-a88b-ba4f746b6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:00.356884 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1169/2345] 10.222.0.44 () {58 vars in 967 bytes} [Tue May 24 10:19:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:19:00.369556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:00.380735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b2e7b-0d4b-4602-ac8d-e42ab392959d service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:00.385765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:00.388641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:00.388641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:00.388641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:00.396191 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:00.397807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:00.406187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1177/2346] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:19:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:19:01.075020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f941e-01ec-4431-81de-ca91415f7c99 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:01.076019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f941e-01ec-4431-81de-ca91415f7c99 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:01.076475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f941e-01ec-4431-81de-ca91415f7c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:01.104589 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f93f941e-01ec-4431-81de-ca91415f7c99 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:19:01.113168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f93f941e-01ec-4431-81de-ca91415f7c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:01.119203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1170/2347] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:19:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:19:01.131874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:01.143033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576b0e8-66a7-409a-a11c-34abd1f74595 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:01.148242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:01.148869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:01.149152 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:01.149426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:01.157974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:01.159536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:01.167725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1178/2348] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:19:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 10:19:01.733665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc933-3ac9-417f-8925-4dd839489a3c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:01.734143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc933-3ac9-417f-8925-4dd839489a3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:01.734244 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc933-3ac9-417f-8925-4dd839489a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:01.752557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-18ccc933-3ac9-417f-8925-4dd839489a3c None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:19:01.753728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18ccc933-3ac9-417f-8925-4dd839489a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:01.760758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1171/2349] 10.222.0.44 () {58 vars in 967 bytes} [Tue May 24 10:19:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:19:01.772709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:01.782975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde6832-94b2-4ec9-8218-24c8cb9df7ce service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:01.787944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:01.788574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:01.788859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:01.789140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:01.797084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:01.799145 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:01.807564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1179/2350] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:19:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:19:02.887442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945053-6635-4cbf-9a13-40f332442ea2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:02.887918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945053-6635-4cbf-9a13-40f332442ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:02.888039 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa945053-6635-4cbf-9a13-40f332442ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:02.912304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aa945053-6635-4cbf-9a13-40f332442ea2 None None] MFA Rules not processed for user `aa03c345613842c5a202aa30bc05b229`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:19:02.912304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa945053-6635-4cbf-9a13-40f332442ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:03.025787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1172/2351] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:19:04.452300 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:04.509166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:04.514857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957624-7f2d-44de-bd41-7497fc948c0a service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:04.519480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:04.520383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:04.520669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:04.520949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] PATH_INFO: `/v3/users/1c4272b3e96046448437bd4a4d9a66db` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:04.522137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4272b3e96046448437bd4a4d9a66db)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:04.524150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:04.739168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4272b3e96046448437bd4a4d9a66db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:04.752078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4272b3e96046448437bd4a4d9a66db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:04.752774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4272b3e96046448437bd4a4d9a66db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:04.845285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4272b3e96046448437bd4a4d9a66db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:04.845911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4272b3e96046448437bd4a4d9a66db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:04.862183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1180/2352] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:19:04 2022] DELETE /identity/v3/users/1c4272b3e96046448437bd4a4d9a66db => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:19:04.867142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:04.867560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:04.868010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:04.888206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:19:04.889495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:04.955296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1173/2353] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:19:04.963880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:04.965321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:05.028117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b75dc-fe6f-40d9-a00b-502649f13f3f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:05.032586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:05.033335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:05.033624 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:05.033903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:05.044872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:05.046498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:05.060222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1181/2354] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:05.302053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:05.302053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:05.312462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e568a45-fcbd-4179-a575-53a5b0ba2ee0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:05.317195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:05.322192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:05.322488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:05.325223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] PATH_INFO: `/v3/projects/87e26b35daa3412db248234ca5709b28` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:05.325223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e26b35daa3412db248234ca5709b28)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:05.326024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:05.452340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:05.468718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e26b35daa3412db248234ca5709b28', 'request_id': 'req-660c3479-3da6-4d08-b5f3-41970ffe7cd0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:05.564971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e26b35daa3412db248234ca5709b28', 'request_id': 'req-660c3479-3da6-4d08-b5f3-41970ffe7cd0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:05.571717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e26b35daa3412db248234ca5709b28', 'request_id': 'req-660c3479-3da6-4d08-b5f3-41970ffe7cd0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:05.583232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] The token cache is being invalidate because project 87e26b35daa3412db248234ca5709b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:19:05.583527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:05.584183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:19:05.585717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1174/2355] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:19:05 2022] DELETE /identity/v3/projects/87e26b35daa3412db248234ca5709b28 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:19:15.053036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:15.622295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:17.653852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:17.655516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:17.667355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92fcb8-8cf8-4ec0-817f-c2bd37840fd1 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:17.715592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:17.716276 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:17.716562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:17.716840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:17.718607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:17.798915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:17.800394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6d26b-7e85-48ed-b0f3-2c119452ae85 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:17.819736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1182/2356] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:21.291367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:21.292815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:21.304808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c3479-3da6-4d08-b5f3-41970ffe7cd0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:21.308350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:21.308983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:21.309267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:21.309545 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:21.311220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:21.324817 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:21.326240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:21.337867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1175/2357] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:27.817224 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=63 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:29.076139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:29.076740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:29.076740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:29.095050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] MFA Rules not processed for user `eec86bb8790745aaaa45b6d9e4d94ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:19:29.096275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:29.156876 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1183/2358] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:19:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:19:29.451233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:29.459998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98965da5-8397-4c48-877b-eceb41d6df2b service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:29.463671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:29.464445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:29.464760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:29.465036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:29.466752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:29.475980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:29.477449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:29.485983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1176/2359] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:29.861492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:29.862991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:29.942273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4159c7-5592-4b5f-91f0-a0d7195b4b91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:29.951892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:29.951892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:29.951892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:29.951892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:29.952310 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:29.962535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:29.964161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:29.974596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1184/2360] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:35.076957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:35.079020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:35.089351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ec4b-e6a1-4907-84af-87ab251eb7d3 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:35.092913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:35.093538 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:35.093928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:35.094328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:35.096052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:35.104941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:35.106364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:35.114194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1177/2361] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:35.447690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:35.449396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:35.464948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aec3b-0fe5-4a5d-8ae1-01774dc26c39 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:35.470714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:35.471440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:35.471733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:35.472044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:35.473806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:35.484899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:35.486457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:35.495353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1185/2362] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:38.702472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:38.704566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:38.759850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c4415-e570-4e87-af01-c8226e0fa3b6 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:38.763404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:38.764072 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:38.764355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:38.764632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:38.767014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:38.824908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:38.826359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:38.836400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1178/2363] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:45.491227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=63 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:47.770494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:47.772133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:47.791240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f56d2a-cdca-428f-8e80-e2a309989250 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:47.797311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:47.797957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:47.798246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:47.798523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:47.800536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:47.817391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:47.817391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:47.825757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1186/2364] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:48.144872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:48.152806 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=67 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:48.160907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8810-586e-49c2-901c-b177a1773ea8 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:48.166443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:48.167096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:48.167378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:48.167651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:48.169537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:48.184150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:48.186355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:48.221223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1179/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:50.679714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:19:50.692245 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6248-6de1-4597-89aa-53a67a5adf09 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:19:50.697954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:19:50.698620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:19:50.698950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:19:50.699229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:19:50.701324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:19:50.766691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:19:50.768483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:19:50.779902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1187/2366] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:19:58.196720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:00.774102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=34 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:08.204837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:08.213090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fb16f-67bd-4b48-86ae-6b7e06f66f9f service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:08.216763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:08.217468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:08.226747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:08.226747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:08.226747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:08.283864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:08.285334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:08.295092 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1180/2367] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:20:12.082205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:12.084324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:12.109009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efcf39-a680-4e99-918f-fa0e227187bc service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:12.115565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:12.116564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:12.118083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:12.118083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] PATH_INFO: `/v3/users/04058cb7cf374eba92fb7ee796084e20` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:12.118513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04058cb7cf374eba92fb7ee796084e20)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:12.120690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:12.272485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04058cb7cf374eba92fb7ee796084e20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.285761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04058cb7cf374eba92fb7ee796084e20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.286518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04058cb7cf374eba92fb7ee796084e20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.372816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04058cb7cf374eba92fb7ee796084e20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.373549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-17ea2d53-7c1a-43cc-8152-ae11e1f1395c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04058cb7cf374eba92fb7ee796084e20'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.387168 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1188/2368] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:20:12 2022] DELETE /identity/v3/users/04058cb7cf374eba92fb7ee796084e20 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:20:12.651560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:12.661706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9756b7e-d84b-44fb-a102-a6cfcf6e76a0 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:12.758717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:12.759604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:12.759914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:12.760191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] PATH_INFO: `/v3/projects/544ebc06855b4435b767c0cc885ec068` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:12.761829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=544ebc06855b4435b767c0cc885ec068)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:12.764001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:12.909599 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544ebc06855b4435b767c0cc885ec068', 'request_id': 'req-dbc62875-a4f2-42d1-b212-11c650929ed2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.987087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544ebc06855b4435b767c0cc885ec068', 'request_id': 'req-dbc62875-a4f2-42d1-b212-11c650929ed2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:12.999396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544ebc06855b4435b767c0cc885ec068', 'request_id': 'req-dbc62875-a4f2-42d1-b212-11c650929ed2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:13.011504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] The token cache is being invalidate because project 544ebc06855b4435b767c0cc885ec068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:20:13.011876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:13.012580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc62875-a4f2-42d1-b212-11c650929ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:13.016247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1181/2369] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:20:12 2022] DELETE /identity/v3/projects/544ebc06855b4435b767c0cc885ec068 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:20:13.019587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.019767 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.020366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.041345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:20:13.042570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:13.122589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1189/2370] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:20:13.140149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.140149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.140149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.156022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:20:13.157432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:13.167867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1182/2371] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:20:13.173134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.185323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c5af5-61a7-4175-95e0-7cc8942aeef7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.196181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.197727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.197727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.197727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.198625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:20:13.199155 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.201015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.219527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1190/2372] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:20:13.224078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.234955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d073772-1872-4cf1-8a98-52b3f9b3406d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.242666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.243392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.249069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.249069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.249069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.249069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.264902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:13.375850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1183/2373] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:20:13 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:20:13.376863 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.386918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a0b6c-7986-4f29-8f83-19a51b1312a2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.457742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.458423 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.458960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.459294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.460030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.461947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.469565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:13.556481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1191/2374] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:20:13 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:20:13.557492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.567829 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5566-f4ba-44ed-8d31-417770510609 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.572901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.573560 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.573844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.574118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.574842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.577098 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.588078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1184/2375] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:20:13.592271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.602916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc75be3-3b82-455d-af0a-f385b58a2c7c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.607725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1aa8c-e2a6-4bcb-b6c4-dd856a215488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.608674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1aa8c-e2a6-4bcb-b6c4-dd856a215488 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.608979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1aa8c-e2a6-4bcb-b6c4-dd856a215488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.609248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1aa8c-e2a6-4bcb-b6c4-dd856a215488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.609976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1aa8c-e2a6-4bcb-b6c4-dd856a215488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.611579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1aa8c-e2a6-4bcb-b6c4-dd856a215488 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.622441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1192/2376] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:20:13.630971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.636759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa934-021b-4c2a-8dc6-2a1b7e394cbb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.642059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.643103 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.643389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.643671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] PATH_INFO: `/v3/projects/f868bceb050645bea79affcb406f94d1/users/4985774959804070b1d86f7e47b02473/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.660089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f868bceb050645bea79affcb406f94d1, user_id=4985774959804070b1d86f7e47b02473, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.662762 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.733580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1185/2377] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:20:13 2022] PUT /identity/v3/projects/f868bceb050645bea79affcb406f94d1/users/4985774959804070b1d86f7e47b02473/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:20:13.738898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.739187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.739467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.758369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:20:13.759662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:13.826883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1193/2378] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:20:13.837409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:13.839229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:13.940667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6170b9-d712-46c5-8f86-b89f3a41687d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:13.946539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:13.947210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:13.947625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:13.947961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:13.960881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:13.964842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:13.981742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1186/2379] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:20:17.543149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:17.545676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:17.559593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81543fdd-4c2e-46c8-a9f7-433b565a3930 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:17.565407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:17.566338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:17.566621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:17.566898 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] PATH_INFO: `/v3/users/aa03c345613842c5a202aa30bc05b229` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:17.568202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa03c345613842c5a202aa30bc05b229)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:17.570157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:17.828370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa03c345613842c5a202aa30bc05b229'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:17.840775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa03c345613842c5a202aa30bc05b229'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:17.841524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa03c345613842c5a202aa30bc05b229'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:17.919159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa03c345613842c5a202aa30bc05b229'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:17.919885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e5d97387-91ee-47a3-937e-030979a1d641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa03c345613842c5a202aa30bc05b229'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:17.935987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1194/2380] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:20:17 2022] DELETE /identity/v3/users/aa03c345613842c5a202aa30bc05b229 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:20:18.228878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:18.262208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cb00f-1c61-4d64-b50f-d66ea663ebca service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:18.355834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:18.357075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:18.357973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:18.358425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] PATH_INFO: `/v3/projects/5cc2c0063a4443d2858152dd95bc074d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:18.360107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc2c0063a4443d2858152dd95bc074d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:18.362659 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:18.523860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc2c0063a4443d2858152dd95bc074d', 'request_id': 'req-3d56a74e-6b59-4096-b0b4-4de10b295c8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:18.644269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc2c0063a4443d2858152dd95bc074d', 'request_id': 'req-3d56a74e-6b59-4096-b0b4-4de10b295c8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:18.652433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc2c0063a4443d2858152dd95bc074d', 'request_id': 'req-3d56a74e-6b59-4096-b0b4-4de10b295c8a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:18.662446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:18.689986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] The token cache is being invalidate because project 5cc2c0063a4443d2858152dd95bc074d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:20:18.690374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:18.691135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3d56a74e-6b59-4096-b0b4-4de10b295c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:20:18.693998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1187/2381] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:20:18 2022] DELETE /identity/v3/projects/5cc2c0063a4443d2858152dd95bc074d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:20:19.229392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:19.229912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:19.230042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:19.249885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] MFA Rules not processed for user `06e9e172155548289ca938421d4e32bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:20:19.251278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:19.308685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:19.324238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1195/2382] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:20:20.633801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209a2b-926c-4ffd-a108-48985fce1b95 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:20.634770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209a2b-926c-4ffd-a108-48985fce1b95 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:20.635270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209a2b-926c-4ffd-a108-48985fce1b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:20.672923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ac209a2b-926c-4ffd-a108-48985fce1b95 None None] MFA Rules not processed for user `4985774959804070b1d86f7e47b02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:20:20.674248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ac209a2b-926c-4ffd-a108-48985fce1b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:20.742767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1188/2383] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:20:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:20:20.757663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:20.759319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:20.838360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034db28-4f93-4cf7-afe3-160e3b2c6417 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:20.845594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:20.850026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:20.850026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:20.850026 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:20.855902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:20.858205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:20.868190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1196/2384] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:20:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:20:23.780885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:23.781392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:23.781518 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:23.801050 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] MFA Rules not processed for user `4985774959804070b1d86f7e47b02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:20:23.802284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:23.809541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1189/2385] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:20:30.863606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=36 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:31.572824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:20:31.574424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:31.589645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2708d-33a2-4ead-bc49-ce2aa80a1718 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:20:31.597070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:20:31.597070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:20:31.597308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:20:31.597514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:20:31.599285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:20:31.611464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:20:31.613078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:20:31.623846 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1197/2386] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:20:33.793936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:41.619138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:02.433418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:02.434904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:02.495945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249084e-7444-4806-ab82-32c40c8fcdfc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:02.500455 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:02.501185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:02.501430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:02.501740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:02.503643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:02.568973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:02.570517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:02.581496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1190/2387] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:06.075960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:06.078040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:06.151643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ce5a6-0843-48f8-88c4-9efd6b20fd44 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:06.157405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:06.158047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:06.158327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:06.158598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:06.160417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:06.171574 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:06.173217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:06.183431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1198/2388] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:06.205034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:06.205801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:06.218848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea26ef-a456-45ef-8d88-d3edd8bdfe70 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:06.223742 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:06.224652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:06.224943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:06.225228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] PATH_INFO: `/v3/users/eec86bb8790745aaaa45b6d9e4d94ca7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:06.226421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec86bb8790745aaaa45b6d9e4d94ca7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:06.228498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:06.376822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec86bb8790745aaaa45b6d9e4d94ca7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.389142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec86bb8790745aaaa45b6d9e4d94ca7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.390444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec86bb8790745aaaa45b6d9e4d94ca7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.391046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec86bb8790745aaaa45b6d9e4d94ca7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.455356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-174f47d9-0f3e-4b45-a684-bb3ef89221de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec86bb8790745aaaa45b6d9e4d94ca7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.468352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1191/2389] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:06 2022] DELETE /identity/v3/users/eec86bb8790745aaaa45b6d9e4d94ca7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:06.728571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:06.743111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd7b92-a8af-49fa-99a9-e503df6c4f2d service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:06.803840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:06.804700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:06.804979 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:06.805251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] PATH_INFO: `/v3/projects/ec0a495fa51c4f038a6d18b3185bcbb0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:06.806408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0a495fa51c4f038a6d18b3185bcbb0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:06.808455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:06.937896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'request_id': 'req-365fa41a-e0af-4b45-9465-fdd6db801f57'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.944648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'request_id': 'req-365fa41a-e0af-4b45-9465-fdd6db801f57'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:06.950112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'request_id': 'req-365fa41a-e0af-4b45-9465-fdd6db801f57'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:07.028048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] The token cache is being invalidate because project ec0a495fa51c4f038a6d18b3185bcbb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:07.028334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:07.028997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365fa41a-e0af-4b45-9465-fdd6db801f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:07.030530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1199/2390] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:06 2022] DELETE /identity/v3/projects/ec0a495fa51c4f038a6d18b3185bcbb0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:07.036021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.036320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.036628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.055413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:07.056651 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:07.073860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:07.116597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1192/2391] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:07.124890 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.125720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.125720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.144724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:07.145999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:07.154346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1200/2392] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:07.159031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.168474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2628b8-acbd-4ab3-b8eb-d60871a5c9d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.173786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.174428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.174707 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.174980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.175698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:07.176032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.177617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.189246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1193/2393] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:07.193515 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.203139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271fba0-ac10-47ef-a4ce-f5f36de8d735 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.208106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.208789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.209352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.209662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.210403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.212458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.223048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:07.322014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1201/2394] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:07.327112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.339717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa2cc9-a403-4fd6-ba1e-cac4bb09fb5a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.399579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.400330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.400636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.400916 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.401654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.403725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.465317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1194/2395] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:07 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:07.470213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.481027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e646-dd27-4ac3-b1a1-d5a4bb6239fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.486100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.486786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.487097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.487397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.488219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.489949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.500697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1202/2396] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:07.504528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.515043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658074a-d9d1-445b-9aa0-afef39c77824 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.520850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda00d3-c9e9-4fee-946f-01dfb4ee3e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.521540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda00d3-c9e9-4fee-946f-01dfb4ee3e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.521830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda00d3-c9e9-4fee-946f-01dfb4ee3e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.522112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda00d3-c9e9-4fee-946f-01dfb4ee3e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.522838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda00d3-c9e9-4fee-946f-01dfb4ee3e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.524508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda00d3-c9e9-4fee-946f-01dfb4ee3e88 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.535374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1195/2397] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:07.539576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.550055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c7d7-dd28-417a-9842-892fe750797b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.554860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.555787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.556126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.556427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] PATH_INFO: `/v3/projects/b1371132d23044b0aa07e9f976f666ec/users/31a47c557bfc4cbe8e25835772bf65c5/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.571737 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1371132d23044b0aa07e9f976f666ec, user_id=31a47c557bfc4cbe8e25835772bf65c5, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.574618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.646379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1203/2398] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:07 2022] PUT /identity/v3/projects/b1371132d23044b0aa07e9f976f666ec/users/31a47c557bfc4cbe8e25835772bf65c5/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:07.657913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.658234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.658530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.685184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] MFA Rules not processed for user `31a47c557bfc4cbe8e25835772bf65c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:07.686378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:07.749682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1196/2399] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:07.761091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:07.762795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:07.836534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b477b-c5ee-4ac2-b072-39c8fe98a523 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:07.842002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e484ea2-f7e7-4b8c-8214-646da821e297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:07.842650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e484ea2-f7e7-4b8c-8214-646da821e297 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:07.842937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e484ea2-f7e7-4b8c-8214-646da821e297 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:07.843217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e484ea2-f7e7-4b8c-8214-646da821e297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:07.851207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e484ea2-f7e7-4b8c-8214-646da821e297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:07.852813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e484ea2-f7e7-4b8c-8214-646da821e297 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:07.861367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1204/2400] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:16.019370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:16.037013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:16.084739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f3a0d-38a2-4ff8-9182-889c0cec3629 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:16.089274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:16.090177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:16.090511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:16.090790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] PATH_INFO: `/v3/users/31a47c557bfc4cbe8e25835772bf65c5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:16.091997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a47c557bfc4cbe8e25835772bf65c5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:16.093946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:16.285311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a47c557bfc4cbe8e25835772bf65c5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:16.297468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a47c557bfc4cbe8e25835772bf65c5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:16.298164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a47c557bfc4cbe8e25835772bf65c5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:16.298784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a47c557bfc4cbe8e25835772bf65c5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:16.403427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a47c557bfc4cbe8e25835772bf65c5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:16.417626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1197/2401] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:16 2022] DELETE /identity/v3/users/31a47c557bfc4cbe8e25835772bf65c5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:16.422182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:16.422664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:16.422878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:16.442502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:16.443753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:16.505592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1205/2402] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:16.514788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:16.516288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:16.575497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c558c-c91a-4fa1-a96e-0e5d4543b054 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:16.579164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fd0cd-002a-45f7-a350-4e10307e77e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:16.579822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fd0cd-002a-45f7-a350-4e10307e77e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:16.580127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fd0cd-002a-45f7-a350-4e10307e77e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:16.580410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fd0cd-002a-45f7-a350-4e10307e77e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:16.589744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fd0cd-002a-45f7-a350-4e10307e77e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:16.591204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fd0cd-002a-45f7-a350-4e10307e77e5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:16.600678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1198/2403] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:17.044429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.046305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:17.058255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461f442-11c7-443b-b66b-85e6c08944bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.062950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.063836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.064320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.064445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] PATH_INFO: `/v3/projects/b1371132d23044b0aa07e9f976f666ec` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.065643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1371132d23044b0aa07e9f976f666ec)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.067946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.182719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:17.197821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1371132d23044b0aa07e9f976f666ec', 'request_id': 'req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:17.204264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1371132d23044b0aa07e9f976f666ec', 'request_id': 'req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:17.210838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1371132d23044b0aa07e9f976f666ec', 'request_id': 'req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:17.332581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] The token cache is being invalidate because project b1371132d23044b0aa07e9f976f666ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:17.332990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:17.333620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a5a8a28-8dce-4a83-8a84-178adc3ab9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:17.335418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1206/2404] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:17 2022] DELETE /identity/v3/projects/b1371132d23044b0aa07e9f976f666ec => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:17.340551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.341059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.341170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.359416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:17.360725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:17.393649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:17.421058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1199/2405] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:17.428818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.429483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.429483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.450074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:17.450298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:17.458851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1207/2406] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:17.463483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.474519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d411ea6-539d-4119-b5f3-92edb732b936 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.479193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.479872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.480162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.480442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.481193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:17.481562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.483093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.495871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1200/2407] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:17.500583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.511153 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746aba5-c8f6-48f8-9b7f-688382d034c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.517441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.517441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.517441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.517441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.517942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.520511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.598802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1208/2408] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:17 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:17.602941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.614798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3ce98-96b1-4fea-a74f-1d579d8a0d68 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.670277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.670941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.671226 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.671499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.672214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.674128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.760907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1201/2409] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:17 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:17.765065 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.775691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2175b-908c-4e55-8304-129ae681aaae admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.780313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.781115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.781404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.781686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.782405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.784082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.794370 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1209/2410] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:17.798282 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.808859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbf2ee-8c01-4955-a9e8-8017dfac7995 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.813493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92b86e-1e7e-45f2-a1e6-d367036f1d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.814142 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b86e-1e7e-45f2-a1e6-d367036f1d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.814427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b86e-1e7e-45f2-a1e6-d367036f1d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.814708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92b86e-1e7e-45f2-a1e6-d367036f1d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.815462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92b86e-1e7e-45f2-a1e6-d367036f1d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.817814 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92b86e-1e7e-45f2-a1e6-d367036f1d75 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.827493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1202/2411] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:17.831427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:17.841658 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731ce83-6014-41cd-a6ca-141f176bdba2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:17.846352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:17.847336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.847641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.847958 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] PATH_INFO: `/v3/projects/483713a487cd4399bd49dba3d39b13e8/users/c509f3e24260405589c702b2a3218fbd/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.862222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483713a487cd4399bd49dba3d39b13e8, user_id=c509f3e24260405589c702b2a3218fbd, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:17.865331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:17.962554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1210/2412] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:17 2022] PUT /identity/v3/projects/483713a487cd4399bd49dba3d39b13e8/users/c509f3e24260405589c702b2a3218fbd/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:17.968003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232619d-cbfe-46d5-b4c1-ad204ad4b980 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:17.968295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232619d-cbfe-46d5-b4c1-ad204ad4b980 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:17.968576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232619d-cbfe-46d5-b4c1-ad204ad4b980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:17.986448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8232619d-cbfe-46d5-b4c1-ad204ad4b980 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:17.988159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8232619d-cbfe-46d5-b4c1-ad204ad4b980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:18.044178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1203/2413] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:18.054244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:18.055951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:18.115211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d3368-bdd7-4ee4-9ee6-7f705bfe74f7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:18.119377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:18.120050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:18.120334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:18.120610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:18.130540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:18.132051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:18.141388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1211/2414] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:19.472715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:19.473315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:19.474392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:19.501212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] MFA Rules not processed for user `c509f3e24260405589c702b2a3218fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:19.502437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:19.536929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:19.566791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1204/2415] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:19.571246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:19.580745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6bf6b-fdaa-455a-a6f5-9c58f65c45ca service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:19.586126 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:19.586719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:19.587002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:19.587279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:19.587993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:19.589878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:19.670333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1212/2416] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:19 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:19.674451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:19.686625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb7538-3acf-4aaf-b6a9-9ae929dfa53d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:19.742676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:19.743347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:19.743635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:19.743952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:19.744636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:19.746624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:19.888863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1205/2417] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:19 2022] POST /identity/v3/users => generated 308 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:19.893161 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:19.903724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fc1a6-a838-4f60-9409-40175647c01d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:19.908261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:19.908915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:19.909199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:19.910057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:19.910792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:19.912413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:19.922856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1213/2418] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:19.927429 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:19.937366 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5aef7-1d87-4505-82c6-5c18c78f1f28 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:19.941968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:19.942839 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:19.943123 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:19.943401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] PATH_INFO: `/v3/projects/3e7a2f928faf472bb082a1d30e7c436d/users/a6da11aeff79439d8c59083f79185e1d/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:19.957905 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7a2f928faf472bb082a1d30e7c436d, user_id=a6da11aeff79439d8c59083f79185e1d, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:19.960856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:20.048862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1206/2419] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:19 2022] PUT /identity/v3/projects/3e7a2f928faf472bb082a1d30e7c436d/users/a6da11aeff79439d8c59083f79185e1d/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:20.052899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:20.062695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed2984-3786-4db4-a6d2-f420bf7685f6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:20.081964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:20.121138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899485b2-734c-4e3e-8e00-300011587635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:20.121820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899485b2-734c-4e3e-8e00-300011587635 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:20.122105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899485b2-734c-4e3e-8e00-300011587635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:20.122385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899485b2-734c-4e3e-8e00-300011587635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:20.123112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899485b2-734c-4e3e-8e00-300011587635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:20.124814 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899485b2-734c-4e3e-8e00-300011587635 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:20.142029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1214/2420] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:20.142207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:20.151397 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee988e-f154-450a-8a21-f7b6deca6be6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:20.156485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:20.157361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:20.157643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:20.157918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] PATH_INFO: `/v3/projects/3e7a2f928faf472bb082a1d30e7c436d/users/a6da11aeff79439d8c59083f79185e1d/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:20.160761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7a2f928faf472bb082a1d30e7c436d, user_id=a6da11aeff79439d8c59083f79185e1d, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:20.163382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:20.174158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1207/2421] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:20 2022] PUT /identity/v3/projects/3e7a2f928faf472bb082a1d30e7c436d/users/a6da11aeff79439d8c59083f79185e1d/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:21.436919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:21.437474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:21.437592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:21.469309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] MFA Rules not processed for user `a6da11aeff79439d8c59083f79185e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:21.470545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:21.545784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1215/2422] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:22.875071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:22.941593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a8c29-2bc5-44c6-88ae-b8bb66fe3894 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:22.946157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:22.947054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:22.947336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:22.947611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] PATH_INFO: `/v3/users/c509f3e24260405589c702b2a3218fbd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:22.948824 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c509f3e24260405589c702b2a3218fbd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:22.950804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:23.103848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:23.117074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c509f3e24260405589c702b2a3218fbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.129060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c509f3e24260405589c702b2a3218fbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.129904 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c509f3e24260405589c702b2a3218fbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.130508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c509f3e24260405589c702b2a3218fbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.212107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c509f3e24260405589c702b2a3218fbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.225396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1208/2423] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:22 2022] DELETE /identity/v3/users/c509f3e24260405589c702b2a3218fbd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:23.462746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:23.474387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e010-758a-4134-884f-2ce71a20c176 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:23.556481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:23.557937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:23.558771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:23.559226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] PATH_INFO: `/v3/projects/483713a487cd4399bd49dba3d39b13e8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:23.560776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483713a487cd4399bd49dba3d39b13e8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:23.563037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:23.721035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:23.728384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483713a487cd4399bd49dba3d39b13e8', 'request_id': 'req-f723389b-1cd3-4699-ab4a-7990ec8ee355'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.738619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483713a487cd4399bd49dba3d39b13e8', 'request_id': 'req-f723389b-1cd3-4699-ab4a-7990ec8ee355'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.745493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483713a487cd4399bd49dba3d39b13e8', 'request_id': 'req-f723389b-1cd3-4699-ab4a-7990ec8ee355'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.819449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] The token cache is being invalidate because project 483713a487cd4399bd49dba3d39b13e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:23.819449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.819449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:23.819449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1216/2424] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:23 2022] DELETE /identity/v3/projects/483713a487cd4399bd49dba3d39b13e8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:23.821485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:23.823136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:23.838752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822539-e59c-4e66-9691-744bb71dd08d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:23.895510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:23.896431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:23.896723 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:23.897005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] PATH_INFO: `/v3/users/a6da11aeff79439d8c59083f79185e1d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:23.898280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6da11aeff79439d8c59083f79185e1d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:23.900271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:24.085372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6da11aeff79439d8c59083f79185e1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.098898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6da11aeff79439d8c59083f79185e1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.100105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6da11aeff79439d8c59083f79185e1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.100712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6da11aeff79439d8c59083f79185e1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.174482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15ea88fd-113b-488f-be40-c484042e7b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6da11aeff79439d8c59083f79185e1d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.187566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1209/2425] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:23 2022] DELETE /identity/v3/users/a6da11aeff79439d8c59083f79185e1d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:24.413761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:24.415223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:24.428325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723389b-1cd3-4699-ab4a-7990ec8ee355 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:24.489280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:24.490071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:24.490403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:24.490675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] PATH_INFO: `/v3/projects/3e7a2f928faf472bb082a1d30e7c436d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:24.491908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7a2f928faf472bb082a1d30e7c436d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:24.493824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:24.592565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7a2f928faf472bb082a1d30e7c436d', 'request_id': 'req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.599552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7a2f928faf472bb082a1d30e7c436d', 'request_id': 'req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.605855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7a2f928faf472bb082a1d30e7c436d', 'request_id': 'req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.694922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] The token cache is being invalidate because project 3e7a2f928faf472bb082a1d30e7c436d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:24.695207 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.695962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-94e2125f-b6dd-4ebe-836d-46b66d5bbd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:24.697566 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1217/2426] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:24 2022] DELETE /identity/v3/projects/3e7a2f928faf472bb082a1d30e7c436d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:24.702605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:24.703994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:24.703994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:24.721412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:24.722621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:24.742819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:24.781183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1210/2427] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:24.788805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:24.789176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:24.789520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:24.813556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:24.813556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:24.821411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1218/2428] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:24.826266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:24.837808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b60bb-1023-4fb5-811b-c4d303561845 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:24.842795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:24.843548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:24.843973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:24.844181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:24.844938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:24.845403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:24.847289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:24.860862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1211/2429] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:24.865557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:24.875290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5ba7-aa66-4bd7-bf6e-ceb21eba2d6a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:24.881592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:24.882492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:24.882664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:24.882875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:24.883744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:24.885746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:24.974437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1219/2430] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:24 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:24.978496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:24.989133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d97d-bb13-4126-bf49-dc1af9fbcd23 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.059161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.060669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.061081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.061672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.062490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.064791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.172324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1212/2431] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:24 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:25.173586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.184176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c6dc2-b316-4655-9542-8ddb2c89d701 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.190366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.191657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.200410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.200410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.200410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.200410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.205719 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1220/2432] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:25.210930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.221202 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b489c-ce60-4928-b193-2e5433cb1489 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.226286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dc9bf-2271-408e-981d-c654337615d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.226948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dc9bf-2271-408e-981d-c654337615d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.227254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dc9bf-2271-408e-981d-c654337615d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.227533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dc9bf-2271-408e-981d-c654337615d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.229059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dc9bf-2271-408e-981d-c654337615d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.229969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344dc9bf-2271-408e-981d-c654337615d4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.240689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1213/2433] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:25.244826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.255253 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f032-3740-41a1-aacc-59d9129f9609 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.259859 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.260731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.261012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.261285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] PATH_INFO: `/v3/projects/32acd4c929534317baaf89cd95d39fa4/users/8fdd6b84df2f421cb46e2a6b37bd27f8/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.275667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32acd4c929534317baaf89cd95d39fa4, user_id=8fdd6b84df2f421cb46e2a6b37bd27f8, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.278338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.341608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:25.346510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1221/2434] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:25 2022] PUT /identity/v3/projects/32acd4c929534317baaf89cd95d39fa4/users/8fdd6b84df2f421cb46e2a6b37bd27f8/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:25.356557 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.356974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.357259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.386632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] MFA Rules not processed for user `8fdd6b84df2f421cb46e2a6b37bd27f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:25.387984 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:25.453060 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1214/2435] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:25.457500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.525407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5597d0-d7e0-4bc8-9c88-543c521a5679 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.530110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.530709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.530989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.531266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.532030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.533941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.617223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1222/2436] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:25 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:25.621118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.632456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a752e-d39f-47c8-8ecf-838aeae7411f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.650409 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:25.687483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.688087 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.688573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.689146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.690156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.692186 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.768596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1215/2437] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:25 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:25.772579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.783004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed28fa-e67e-4aee-b960-e2f870435300 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.788181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.788831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.789114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.789386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.790101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.791837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.802343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1223/2438] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:25.806311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.816281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6d8ff-8999-4b3f-b155-3afdc5a60c0a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:25.821160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:25.822152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:25.822438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:25.822715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] PATH_INFO: `/v3/projects/db80360d442f4200aca4f89ab8561e7a/users/1ddf56aec0bf4912a075537e045eb8c3/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:25.838044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db80360d442f4200aca4f89ab8561e7a, user_id=1ddf56aec0bf4912a075537e045eb8c3, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:25.840885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:25.934013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1216/2439] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:25 2022] PUT /identity/v3/projects/db80360d442f4200aca4f89ab8561e7a/users/1ddf56aec0bf4912a075537e045eb8c3/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:25.937943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:25.948549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d989b0-6152-4a32-b6dd-0ba54992f114 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:26.004112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774acf-f3ce-4d47-86c7-b330dfcfbdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:26.004769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774acf-f3ce-4d47-86c7-b330dfcfbdbb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.005052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774acf-f3ce-4d47-86c7-b330dfcfbdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.005323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774acf-f3ce-4d47-86c7-b330dfcfbdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.006032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774acf-f3ce-4d47-86c7-b330dfcfbdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:26.007682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774acf-f3ce-4d47-86c7-b330dfcfbdbb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:26.017705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1224/2440] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:26.022908 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:26.032986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1b84a-5dba-42c0-8cf3-61dea5803a2e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:26.038249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:26.039057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.039336 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.039610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] PATH_INFO: `/v3/projects/db80360d442f4200aca4f89ab8561e7a/users/1ddf56aec0bf4912a075537e045eb8c3/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.041583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db80360d442f4200aca4f89ab8561e7a, user_id=1ddf56aec0bf4912a075537e045eb8c3, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:26.044241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:26.054568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1217/2441] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:26 2022] PUT /identity/v3/projects/db80360d442f4200aca4f89ab8561e7a/users/1ddf56aec0bf4912a075537e045eb8c3/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:26.065558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.065996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.066277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.092476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] MFA Rules not processed for user `1ddf56aec0bf4912a075537e045eb8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:26.093665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:26.152498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:26.162127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1225/2442] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:26.173224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:26.175258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:26.235640 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffea7-2319-49fe-94b3-f7aedd61c036 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:26.239424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96685603-5527-4260-85bc-d336fa530bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:26.240101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685603-5527-4260-85bc-d336fa530bbe service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.240389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685603-5527-4260-85bc-d336fa530bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.240668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96685603-5527-4260-85bc-d336fa530bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.249831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685603-5527-4260-85bc-d336fa530bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:26.251271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96685603-5527-4260-85bc-d336fa530bbe service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:26.261771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1218/2443] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:26.324113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:26.386427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556912e4-b1cb-4a96-9f9d-c63d6e40da42 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:26.390989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:26.391885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.392171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.392447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] PATH_INFO: `/v3/users/8fdd6b84df2f421cb46e2a6b37bd27f8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.394343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdd6b84df2f421cb46e2a6b37bd27f8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:26.396395 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:26.624626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdd6b84df2f421cb46e2a6b37bd27f8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:26.638490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdd6b84df2f421cb46e2a6b37bd27f8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:26.640560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdd6b84df2f421cb46e2a6b37bd27f8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:26.708680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdd6b84df2f421cb46e2a6b37bd27f8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:26.709561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdd6b84df2f421cb46e2a6b37bd27f8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:26.723922 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1226/2444] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:26 2022] DELETE /identity/v3/users/8fdd6b84df2f421cb46e2a6b37bd27f8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:26.728428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.728718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.728996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.747736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:26.748955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:26.809283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1219/2445] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:26.818978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:26.820428 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:26.878977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cecf0-99f4-4fc5-a4fd-1a7e60eab8a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:26.882477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:26.883128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:26.883413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:26.883690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:26.892769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:26.895175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:26.904534 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1227/2446] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:27.505697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:27.507654 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:27.520481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d37d2-418a-42e5-bac0-5ed7f44947f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:27.525515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:27.526384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:27.526668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:27.526941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] PATH_INFO: `/v3/projects/32acd4c929534317baaf89cd95d39fa4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:27.528421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32acd4c929534317baaf89cd95d39fa4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:27.530070 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:27.542726 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:27.626461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32acd4c929534317baaf89cd95d39fa4', 'request_id': 'req-6f867d78-44a5-469c-b827-7a401831054a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:27.705881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32acd4c929534317baaf89cd95d39fa4', 'request_id': 'req-6f867d78-44a5-469c-b827-7a401831054a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:27.713052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32acd4c929534317baaf89cd95d39fa4', 'request_id': 'req-6f867d78-44a5-469c-b827-7a401831054a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:27.724108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] The token cache is being invalidate because project 32acd4c929534317baaf89cd95d39fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:27.724394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:27.725024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:27.726581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1220/2447] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:27 2022] DELETE /identity/v3/projects/32acd4c929534317baaf89cd95d39fa4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:27.730502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:27.740664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46523-fd74-4f8e-afa8-7a620e8caa79 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:27.752668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:27.801644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:27.802836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:27.803121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:27.803396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] PATH_INFO: `/v3/users/1ddf56aec0bf4912a075537e045eb8c3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:27.804642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddf56aec0bf4912a075537e045eb8c3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:27.806688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:28.033564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddf56aec0bf4912a075537e045eb8c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.047837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddf56aec0bf4912a075537e045eb8c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.048586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddf56aec0bf4912a075537e045eb8c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.126174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddf56aec0bf4912a075537e045eb8c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.129049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a7d8cd58-19d5-44b8-9ae6-a9b0ee5444e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddf56aec0bf4912a075537e045eb8c3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.144360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1228/2448] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:27 2022] DELETE /identity/v3/users/1ddf56aec0bf4912a075537e045eb8c3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:28.645339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:28.645769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:28.664622 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f867d78-44a5-469c-b827-7a401831054a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:28.725551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:28.726410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:28.726689 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:28.726962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] PATH_INFO: `/v3/projects/db80360d442f4200aca4f89ab8561e7a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:28.728247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=db80360d442f4200aca4f89ab8561e7a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:28.730155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:28.867532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db80360d442f4200aca4f89ab8561e7a', 'request_id': 'req-bd3ed73e-d582-46c9-8188-88cd9539f3ad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.952059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db80360d442f4200aca4f89ab8561e7a', 'request_id': 'req-bd3ed73e-d582-46c9-8188-88cd9539f3ad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.960248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db80360d442f4200aca4f89ab8561e7a', 'request_id': 'req-bd3ed73e-d582-46c9-8188-88cd9539f3ad'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.972236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] The token cache is being invalidate because project db80360d442f4200aca4f89ab8561e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:28.972529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.973405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd3ed73e-d582-46c9-8188-88cd9539f3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:28.975089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1221/2449] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:28 2022] DELETE /identity/v3/projects/db80360d442f4200aca4f89ab8561e7a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:28.979770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:28.980278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:28.980373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.011627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:29.012950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:29.080335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1229/2450] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:29.088566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.088860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.089135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.110042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:29.111149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:29.121615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1222/2451] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:29.125773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.135758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bcc66-88fb-4412-8e8e-f7f91bc7273e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.140401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.141057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.141343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.141619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.142336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:29.142644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.144853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.156771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1230/2452] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:29.161359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.170582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef584ef-97a3-4477-b04f-dab9c41b1645 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.175710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.176383 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.176663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.176940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.178281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.185233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.267181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1223/2453] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:29 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:29.271610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.281680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be8f6-0201-4126-b5d4-f00dd67a83bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.302435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:29.340388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.341051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.341334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.341605 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.342293 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.344295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.426674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1231/2454] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:29 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:29.430856 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.436412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:29.441743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273136-3740-4ca4-942b-e39cb7ecd651 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.447964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.452979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.452979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.452979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.452979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.452979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.462680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1224/2455] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:29.466915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.477723 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07de1c6-4dbd-459a-837b-10def8f4c504 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.482445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447dc52-b479-49ab-a9c7-aa202ae516c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.483107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447dc52-b479-49ab-a9c7-aa202ae516c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.483392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447dc52-b479-49ab-a9c7-aa202ae516c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.483669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447dc52-b479-49ab-a9c7-aa202ae516c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.484465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447dc52-b479-49ab-a9c7-aa202ae516c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.486045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447dc52-b479-49ab-a9c7-aa202ae516c8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.496617 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1232/2456] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:29.500900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.510789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3b05-275c-4bdb-b6b9-6fda2819453e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.515315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.516219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.516613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.516902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] PATH_INFO: `/v3/projects/8ca11e295c4d44148fa6e795dd57aa7e/users/e455e260c52c4423977a04bf6da116c4/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.530972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca11e295c4d44148fa6e795dd57aa7e, user_id=e455e260c52c4423977a04bf6da116c4, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.533702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.625809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1225/2457] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:29 2022] PUT /identity/v3/projects/8ca11e295c4d44148fa6e795dd57aa7e/users/e455e260c52c4423977a04bf6da116c4/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:29.636413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.636706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.636989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.664316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] MFA Rules not processed for user `e455e260c52c4423977a04bf6da116c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:29.665706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:29.733361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1233/2458] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:29.738355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.801239 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd8e17-05f9-4162-8748-1a3ca72559dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.806121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.806781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.807062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.807377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.808102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.810001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:29.878155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1226/2459] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:29 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:29.882342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:29.893858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140e61e-aebb-4629-b704-d6af2b137c25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:29.948827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:29.949490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:29.949777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:29.950057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:29.950740 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:29.952687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.029439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1234/2460] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:29 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:30.032274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:30.041655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd2264-20bf-4039-9b95-64a0c3910270 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:30.050082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:30.050082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.050289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.050444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.051167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:30.052796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.063646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1227/2461] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:30.068190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:30.078336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd929e-5042-4e06-9afb-9e65a30f03f5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:30.083845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:30.084997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.085284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.085562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] PATH_INFO: `/v3/projects/24edf49db14d4f6f8678c0741c8b9b23/users/02865089cae34ab38460341992e7ec36/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.101248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24edf49db14d4f6f8678c0741c8b9b23, user_id=02865089cae34ab38460341992e7ec36, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:30.106571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.183977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:30.189853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1235/2462] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:30 2022] PUT /identity/v3/projects/24edf49db14d4f6f8678c0741c8b9b23/users/02865089cae34ab38460341992e7ec36/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:30.194734 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:30.204536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c5b16-482e-4317-b28c-2aa1240af410 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:30.266521 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5216-1c54-434e-8627-ac5729ccf415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:30.267269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5216-1c54-434e-8627-ac5729ccf415 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.267638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5216-1c54-434e-8627-ac5729ccf415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.267837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5216-1c54-434e-8627-ac5729ccf415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.269340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd5216-1c54-434e-8627-ac5729ccf415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:30.270860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd5216-1c54-434e-8627-ac5729ccf415 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.280570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1228/2463] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:30.284778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:30.295101 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e76b-acc6-47cd-92c4-e816d057c12b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:30.299699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:30.300606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.306175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.306175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] PATH_INFO: `/v3/projects/24edf49db14d4f6f8678c0741c8b9b23/users/02865089cae34ab38460341992e7ec36/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.306175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24edf49db14d4f6f8678c0741c8b9b23, user_id=02865089cae34ab38460341992e7ec36, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:30.306175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.317503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1236/2464] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:30 2022] PUT /identity/v3/projects/24edf49db14d4f6f8678c0741c8b9b23/users/02865089cae34ab38460341992e7ec36/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:30.328685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.329005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.329332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.357989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] MFA Rules not processed for user `02865089cae34ab38460341992e7ec36`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:30.359258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:30.398571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:30.441943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1229/2465] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:30.453690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:30.455372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:30.514936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5364b-f817-4dbd-8544-3584167fcc81 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:30.519287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c80acc-157a-4f2d-99d0-d4436976bcfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:30.520228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c80acc-157a-4f2d-99d0-d4436976bcfc service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.520449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c80acc-157a-4f2d-99d0-d4436976bcfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.520729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c80acc-157a-4f2d-99d0-d4436976bcfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.530448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c80acc-157a-4f2d-99d0-d4436976bcfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:30.531950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c80acc-157a-4f2d-99d0-d4436976bcfc service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.542008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1237/2466] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:30.673261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:30.735033 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e86cb2-ab40-46f9-ad57-815255127b6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:30.740190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:30.741061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:30.741344 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:30.741618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] PATH_INFO: `/v3/users/e455e260c52c4423977a04bf6da116c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:30.742801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e455e260c52c4423977a04bf6da116c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:30.744782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:30.941109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e455e260c52c4423977a04bf6da116c4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:30.954350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e455e260c52c4423977a04bf6da116c4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:30.955110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e455e260c52c4423977a04bf6da116c4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:30.955730 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e455e260c52c4423977a04bf6da116c4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:31.051935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e455e260c52c4423977a04bf6da116c4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:31.064488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1230/2467] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:30 2022] DELETE /identity/v3/users/e455e260c52c4423977a04bf6da116c4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:31.069123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:31.069614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:31.069742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:31.087968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:31.089147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:31.150359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1238/2468] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:31.160571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:31.162168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:31.208720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:31.220482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf7b0-dfb3-4371-9f26-2b19b96d8dc6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:31.224546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:31.225188 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:31.225472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:31.225750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:31.234681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:31.236149 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:31.246071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1231/2469] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:31.794281 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:31.795700 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:31.808865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0b96-d334-45ce-8c8e-d0e84bf88c15 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:31.813679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:31.814626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:31.814914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:31.815196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] PATH_INFO: `/v3/projects/8ca11e295c4d44148fa6e795dd57aa7e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:31.816694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca11e295c4d44148fa6e795dd57aa7e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:31.818754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:31.984069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca11e295c4d44148fa6e795dd57aa7e', 'request_id': 'req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:31.990959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca11e295c4d44148fa6e795dd57aa7e', 'request_id': 'req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:31.997045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca11e295c4d44148fa6e795dd57aa7e', 'request_id': 'req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.071344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] The token cache is being invalidate because project 8ca11e295c4d44148fa6e795dd57aa7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:32.072137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.072389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.073954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1239/2470] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:31 2022] DELETE /identity/v3/projects/8ca11e295c4d44148fa6e795dd57aa7e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:32.078097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:32.088662 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6879d-3059-4eaa-93fb-d7f564b5a798 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:32.154280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:32.155390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:32.155679 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:32.155993 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] PATH_INFO: `/v3/users/02865089cae34ab38460341992e7ec36` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:32.157220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02865089cae34ab38460341992e7ec36)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:32.160037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:32.370442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02865089cae34ab38460341992e7ec36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.382919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02865089cae34ab38460341992e7ec36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.383570 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02865089cae34ab38460341992e7ec36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.384227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02865089cae34ab38460341992e7ec36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.465489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-632cad8f-c0ee-4daa-b7e9-b73caccfcbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02865089cae34ab38460341992e7ec36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:32.478790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1232/2471] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:32 2022] DELETE /identity/v3/users/02865089cae34ab38460341992e7ec36 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:32.913361 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:32.916661 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:32.928484 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4ac0-4a71-47ba-8b2e-b37efc5d2729 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:32.936443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:32.987222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:32.988217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:32.988506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:32.988789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] PATH_INFO: `/v3/projects/24edf49db14d4f6f8678c0741c8b9b23` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:32.989972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24edf49db14d4f6f8678c0741c8b9b23)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:32.991929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.107336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24edf49db14d4f6f8678c0741c8b9b23', 'request_id': 'req-8481f36b-728a-4f10-b151-c91a3eb75a65'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:33.114842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24edf49db14d4f6f8678c0741c8b9b23', 'request_id': 'req-8481f36b-728a-4f10-b151-c91a3eb75a65'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:33.122128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24edf49db14d4f6f8678c0741c8b9b23', 'request_id': 'req-8481f36b-728a-4f10-b151-c91a3eb75a65'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:33.212352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] The token cache is being invalidate because project 24edf49db14d4f6f8678c0741c8b9b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:33.212648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:33.213739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8481f36b-728a-4f10-b151-c91a3eb75a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:33.214834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1240/2472] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:32 2022] DELETE /identity/v3/projects/24edf49db14d4f6f8678c0741c8b9b23 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:33.219955 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.220452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.220558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.239116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:33.240546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:33.303095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1233/2473] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:33.310868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.311159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.311440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.330134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:33.331393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:33.340185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1241/2474] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:33.344424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:33.351218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:33.359364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb3cb4-e2ef-4ba8-8342-b19a8984e0e3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:33.365192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:33.365854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.366141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.366424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.367151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:33.367463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:33.369096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.381351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1234/2475] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:33.385577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:33.395163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c098-268d-4c69-aaaf-8ad1753a0ab9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:33.399881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:33.400535 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.400820 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.401103 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.401836 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:33.403791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.547059 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1242/2476] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:33 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:33.549442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:33.559685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b7a0-1668-4702-a199-643d2011a1e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:33.631463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:33.631463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.631463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.631463 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.632733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:33.632733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.715389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1235/2477] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:33 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:33.716601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:33.727634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19b6c-fc40-4026-84c8-2fc55a8b6058 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:33.732388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:33.733049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.733336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.733614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.734342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:33.735949 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.747285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1243/2478] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:33.751334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:33.761242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bfecc-a94a-47fc-95fa-0a5d4a2cf683 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:33.765841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd01840-556f-45fd-b49c-82028cf53ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:33.766489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01840-556f-45fd-b49c-82028cf53ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.766773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01840-556f-45fd-b49c-82028cf53ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.767053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01840-556f-45fd-b49c-82028cf53ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.767774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd01840-556f-45fd-b49c-82028cf53ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:33.769944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd01840-556f-45fd-b49c-82028cf53ab9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.780414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1236/2479] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:33.785042 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:33.794786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84fbe-5596-4a0b-bc83-2145f3aa3010 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:33.802234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:33.802234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.802234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.802234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] PATH_INFO: `/v3/projects/2606fdf1db804f8788567da8239c1318/users/0cee17107ca74e199244b2df54fc6a1f/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.816499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2606fdf1db804f8788567da8239c1318, user_id=0cee17107ca74e199244b2df54fc6a1f, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:33.819210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:33.891752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1244/2480] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:33 2022] PUT /identity/v3/projects/2606fdf1db804f8788567da8239c1318/users/0cee17107ca74e199244b2df54fc6a1f/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:33.904804 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:33.905178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:33.905643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:33.933110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] MFA Rules not processed for user `0cee17107ca74e199244b2df54fc6a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:33.934352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:34.000813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1237/2481] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:34.005346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.046307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:34.066758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26793b3-fd7f-4025-9da0-31c10f1de57c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.071301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.071985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.072269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.072581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.073259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.075143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.192988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1245/2482] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:34 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:34.196991 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.207682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533fafd-ff88-4b40-8d5f-a103a7903d88 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.262972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.263656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.263927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.264204 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.264879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.266805 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.273864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:34.375291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1238/2483] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:34 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:34.376572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.387170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85992230-4085-4db5-a3c8-a130e7cc191d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.391869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.392528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.392810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.393086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.394362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.396110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.407070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1246/2484] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:34.411910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.421938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8ae4-f2df-4926-ba5a-f5df04772076 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.430930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.430930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.430930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.430930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] PATH_INFO: `/v3/projects/f07a6ea202534976bc49e43b7050936a/users/3d85c7d0d7fb453da36aa5b25853f2c2/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.449760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07a6ea202534976bc49e43b7050936a, user_id=3d85c7d0d7fb453da36aa5b25853f2c2, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.452554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.534800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1239/2485] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:34 2022] PUT /identity/v3/projects/f07a6ea202534976bc49e43b7050936a/users/3d85c7d0d7fb453da36aa5b25853f2c2/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:34.539077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.549194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c9fa-2ed1-47f5-aa17-43a28832bfa4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.607256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f8ac-34e7-4f8e-aede-d2c59bc1831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.607959 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f8ac-34e7-4f8e-aede-d2c59bc1831e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.608244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f8ac-34e7-4f8e-aede-d2c59bc1831e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.608519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f8ac-34e7-4f8e-aede-d2c59bc1831e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.609299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f8ac-34e7-4f8e-aede-d2c59bc1831e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.610913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f8ac-34e7-4f8e-aede-d2c59bc1831e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.621282 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1247/2486] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:34.625309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.636285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1cee2-86f3-4f81-b1f4-595258776074 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.641081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.641956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.642241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.642520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] PATH_INFO: `/v3/projects/f07a6ea202534976bc49e43b7050936a/users/3d85c7d0d7fb453da36aa5b25853f2c2/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.645131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07a6ea202534976bc49e43b7050936a, user_id=3d85c7d0d7fb453da36aa5b25853f2c2, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.647750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.658177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1240/2487] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:34 2022] PUT /identity/v3/projects/f07a6ea202534976bc49e43b7050936a/users/3d85c7d0d7fb453da36aa5b25853f2c2/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:34.668323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.668621 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.668929 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.696294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] MFA Rules not processed for user `3d85c7d0d7fb453da36aa5b25853f2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:34.697564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:34.765616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1248/2488] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:34.777725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:34.779362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:34.836073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75e188-9d3e-4495-b9a1-55e07c5a3486 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:34.839676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:34.840340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:34.840620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:34.840890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:34.849822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:34.851254 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:34.860644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1241/2489] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:35.027563 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:35.029083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:35.063781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:35.085882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742e71-e2ba-4566-9df4-17a619dea6a3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:35.089781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:35.090422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:35.090703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:35.090976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:35.092804 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:35.153127 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:35.158216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:35.159684 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7db513-96de-4930-bf2d-654b7cd6af18 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:35.162326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986d152-21ad-426a-83b0-eb4870a3f7bd service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:35.166066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:35.166815 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:35.167165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:35.167535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:35.170221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1249/2490] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:35.227192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:35.228601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:35.238399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1242/2491] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:36.977251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:36.978107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:36.978562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:36.998178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:36.999402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:37.066754 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1250/2492] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:37.216513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:37.216513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:37.275333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:37.294229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cf7c9-9560-4bba-a588-1e0fdcaad973 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:37.302948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:37.303883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:37.304345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:37.304630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:37.318183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:37.325290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:37.338784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1243/2493] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:21:40.341914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:40.343703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:40.364587 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a1a1-451f-4557-9307-54867e124bbc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:40.371459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:40.371459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:40.371459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:40.371866 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] PATH_INFO: `/v3/users/06e9e172155548289ca938421d4e32bf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:40.373845 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e9e172155548289ca938421d4e32bf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:40.378086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:40.607701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e9e172155548289ca938421d4e32bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:40.636985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e9e172155548289ca938421d4e32bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:40.638433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e9e172155548289ca938421d4e32bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:40.711525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e9e172155548289ca938421d4e32bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:40.715129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f51caef9-56df-40e3-a9c7-ad1748a6765f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e9e172155548289ca938421d4e32bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:40.732108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:40.751326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1251/2494] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:40 2022] DELETE /identity/v3/users/06e9e172155548289ca938421d4e32bf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:41.106353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:41.118910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40b37c-05cc-4d09-93a2-9808289d2f05 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:41.183501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:41.184472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:41.184753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:41.185023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] PATH_INFO: `/v3/projects/20b9157df136454d83302d24d1768d59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:41.186240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b9157df136454d83302d24d1768d59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:41.188235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:41.333148 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b9157df136454d83302d24d1768d59', 'request_id': 'req-57987d4e-884c-4e01-b361-c89b7ce4add7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:41.459735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b9157df136454d83302d24d1768d59', 'request_id': 'req-57987d4e-884c-4e01-b361-c89b7ce4add7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:41.470568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b9157df136454d83302d24d1768d59', 'request_id': 'req-57987d4e-884c-4e01-b361-c89b7ce4add7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:41.489207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] The token cache is being invalidate because project 20b9157df136454d83302d24d1768d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:41.490820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:41.490820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-57987d4e-884c-4e01-b361-c89b7ce4add7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:41.495841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1244/2495] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:41 2022] DELETE /identity/v3/projects/20b9157df136454d83302d24d1768d59 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:41.497309 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:41.497813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:41.497969 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:41.520849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:41.522010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:41.598146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1252/2496] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:41.607233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330627-f270-4d76-a0f2-efa440109ced None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:41.610736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330627-f270-4d76-a0f2-efa440109ced None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:41.610736 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330627-f270-4d76-a0f2-efa440109ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:41.630509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55330627-f270-4d76-a0f2-efa440109ced None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:41.639591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55330627-f270-4d76-a0f2-efa440109ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:41.640355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1245/2497] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:41.644889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:41.655227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc855325-2372-4542-923f-0d5a4a3f8ff6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:41.663053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:41.663962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:41.664311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:41.664664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:41.665462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:41.665828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:41.667572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:41.681156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1253/2498] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:21:41.685844 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330627-f270-4d76-a0f2-efa440109ced None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:41.696559 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330627-f270-4d76-a0f2-efa440109ced None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:41.702937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:41.702937 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:41.703252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:41.703361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:41.704231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:41.706594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:41.826887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1246/2499] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:41 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:41.828102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:41.842715 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db24635-a8db-4746-bd01-6003cb2a9d22 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:41.916963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:41.917874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:41.918266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:41.918838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:41.919855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:41.927748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.005105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1254/2500] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:41 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:42.006063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.016948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f29f9-f40d-4648-9a0b-5d83aee345e2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.022266 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.038862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.038862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.038862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.038862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.038862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.050583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1247/2501] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:42.055778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.070994 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386da93e-c770-4cf2-8575-d124918a974b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.076829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce215-5c6f-48b8-985b-fc2bdea706e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.081459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce215-5c6f-48b8-985b-fc2bdea706e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.081459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce215-5c6f-48b8-985b-fc2bdea706e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.081459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce215-5c6f-48b8-985b-fc2bdea706e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.081459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ce215-5c6f-48b8-985b-fc2bdea706e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.081459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ce215-5c6f-48b8-985b-fc2bdea706e3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.095832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1255/2502] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:42.097840 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.110406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302cd47-c79b-47d3-8f71-4f524891d3aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.116021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.117041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.117322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.117595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] PATH_INFO: `/v3/projects/3e4a5173b7b14c48be41bbd685cb7e97/users/6ab2759b5aca417b9572ee0955d13115/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.137231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4a5173b7b14c48be41bbd685cb7e97, user_id=6ab2759b5aca417b9572ee0955d13115, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.140735 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.246769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1248/2503] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:42 2022] PUT /identity/v3/projects/3e4a5173b7b14c48be41bbd685cb7e97/users/6ab2759b5aca417b9572ee0955d13115/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:42.257115 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.257412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.257694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.292421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] MFA Rules not processed for user `6ab2759b5aca417b9572ee0955d13115`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:42.293679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:42.360848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:42.372895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1256/2504] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:42.377678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.388625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:42.454999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807cbf5-c725-4e65-86cb-98eccc781811 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.461349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.462017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.462303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.462583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.463295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.465443 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.575759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1249/2505] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:42 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:42.580571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.597853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667f6c-8726-4720-8d63-b4e3f58a0623 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.667874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.668458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.668750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.669124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.669829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.671769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.770418 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1257/2506] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:42 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:42.774418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.794727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70716b-7834-4ff7-b727-e814e8b63c01 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.805761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.806540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.806926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.807279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.808152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.809867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.823834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1250/2507] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:42.826116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.842174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80876367-7f56-435f-9c97-f7455f773238 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.847763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.849454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.849454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.849454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] PATH_INFO: `/v3/projects/072128bd6ffd4d088097e99f57f73745/users/bfe65291ca724529a2109e35ad804817/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.866770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072128bd6ffd4d088097e99f57f73745, user_id=bfe65291ca724529a2109e35ad804817, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.869482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.897859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:42.903706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:42.918393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55caf2e-f785-45af-b76d-b8037b4acf56 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:42.925949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:42.926832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:42.927120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:42.927396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] PATH_INFO: `/v3/users/0cee17107ca74e199244b2df54fc6a1f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:42.928649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cee17107ca74e199244b2df54fc6a1f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:42.930648 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:42.963600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1258/2508] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:42 2022] PUT /identity/v3/projects/072128bd6ffd4d088097e99f57f73745/users/bfe65291ca724529a2109e35ad804817/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:42.968008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:43.071083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875c01-8cdf-4090-8c62-a7e3ca5eaf13 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:43.076485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:43.077221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:43.077509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:43.077842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:43.078578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:43.080251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:43.106645 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1259/2509] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:43.107752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:43.122090 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cee17107ca74e199244b2df54fc6a1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:43.139003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f976c-f2d0-4439-9923-e43e2cf049bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:43.154074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cee17107ca74e199244b2df54fc6a1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:43.154074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cee17107ca74e199244b2df54fc6a1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:43.154074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cee17107ca74e199244b2df54fc6a1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:43.155410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad548f5-d8ba-4479-8a47-73c794322671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:43.156614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad548f5-d8ba-4479-8a47-73c794322671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:43.156900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad548f5-d8ba-4479-8a47-73c794322671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:43.157182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad548f5-d8ba-4479-8a47-73c794322671 admin admin] PATH_INFO: `/v3/projects/072128bd6ffd4d088097e99f57f73745/users/bfe65291ca724529a2109e35ad804817/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:43.160385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad548f5-d8ba-4479-8a47-73c794322671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072128bd6ffd4d088097e99f57f73745, user_id=bfe65291ca724529a2109e35ad804817, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:43.163184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad548f5-d8ba-4479-8a47-73c794322671 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:43.175349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1260/2510] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:43 2022] PUT /identity/v3/projects/072128bd6ffd4d088097e99f57f73745/users/bfe65291ca724529a2109e35ad804817/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:43.187527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:43.187856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:43.188211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:43.216976 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] MFA Rules not processed for user `bfe65291ca724529a2109e35ad804817`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:43.218523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:43.262699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6804490a-66a5-4da8-93cc-2d2b5055ed0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cee17107ca74e199244b2df54fc6a1f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:43.270906 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:43.295923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1251/2511] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:42 2022] DELETE /identity/v3/users/0cee17107ca74e199244b2df54fc6a1f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:43.303884 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:43.304182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:43.304468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:43.325663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:43.331266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1261/2512] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:43.331408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:43.339678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:43.342112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:43.404928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:43.426006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53782174-413c-48eb-b5ee-43cbdfc3e5f3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:43.427312 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1252/2513] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:43.435303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:43.436977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:43.509066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:43.510007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:43.510580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:43.511017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:43.511405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c36c2-8261-4c12-b9c5-3962210f9bcb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:43.515258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:43.515944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:43.516230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:43.516508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:43.528655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:43.532077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:43.548437 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1253/2514] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:43.597073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:43.598835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:43.621242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1262/2515] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:44.341871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:44.343404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:44.375597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f13d-be61-42dc-a907-a6599952a51d service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:44.382835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:44.383779 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:44.384238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:44.384515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] PATH_INFO: `/v3/projects/2606fdf1db804f8788567da8239c1318` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:44.385875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] RBAC: Authorizing `identity:delete_project(project_id=2606fdf1db804f8788567da8239c1318)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:44.387869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:44.539954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2606fdf1db804f8788567da8239c1318', 'request_id': 'req-4175e958-2a74-47b1-931a-c7866b40bada'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:44.749809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2606fdf1db804f8788567da8239c1318', 'request_id': 'req-4175e958-2a74-47b1-931a-c7866b40bada'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:44.757537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2606fdf1db804f8788567da8239c1318', 'request_id': 'req-4175e958-2a74-47b1-931a-c7866b40bada'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:44.775912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] The token cache is being invalidate because project 2606fdf1db804f8788567da8239c1318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:44.776532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:44.777364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:44.782777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1254/2516] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:44 2022] DELETE /identity/v3/projects/2606fdf1db804f8788567da8239c1318 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:44.784311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:44.795036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebfb12-7145-4cba-a786-22d107458a0a service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:44.846500 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:44.879871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:44.883829 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:44.884369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:44.885367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] PATH_INFO: `/v3/users/3d85c7d0d7fb453da36aa5b25853f2c2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:44.887259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d85c7d0d7fb453da36aa5b25853f2c2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:44.889350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:45.072729 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d85c7d0d7fb453da36aa5b25853f2c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.086431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d85c7d0d7fb453da36aa5b25853f2c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.088962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d85c7d0d7fb453da36aa5b25853f2c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.131641 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:45.133502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:45.148210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175e958-2a74-47b1-931a-c7866b40bada admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:45.155357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:45.156345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:45.156635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:45.156912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] PATH_INFO: `/v3/users/6ab2759b5aca417b9572ee0955d13115` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:45.158114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab2759b5aca417b9572ee0955d13115)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:45.161166 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:45.191507 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d85c7d0d7fb453da36aa5b25853f2c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.192167 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ce91f51d-1416-45c3-8754-0bb1193da356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d85c7d0d7fb453da36aa5b25853f2c2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.210594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1263/2517] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:44 2022] DELETE /identity/v3/users/3d85c7d0d7fb453da36aa5b25853f2c2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:45.369643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab2759b5aca417b9572ee0955d13115'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.395124 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab2759b5aca417b9572ee0955d13115'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.400365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab2759b5aca417b9572ee0955d13115'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.401183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab2759b5aca417b9572ee0955d13115'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.466359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab2759b5aca417b9572ee0955d13115'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.473179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:45.494907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1255/2518] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:45 2022] DELETE /identity/v3/users/6ab2759b5aca417b9572ee0955d13115 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:45.496736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:45.497034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:45.497313 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:45.518839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:45.520354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:45.616953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1264/2519] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:45.637809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:45.639427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:45.720224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258e42-2a08-47a6-98c4-4fe1bd05a314 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:45.724593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c0fd-0b70-419f-9df5-18c7e126c5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:45.725236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c0fd-0b70-419f-9df5-18c7e126c5bb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:45.725522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c0fd-0b70-419f-9df5-18c7e126c5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:45.725838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c0fd-0b70-419f-9df5-18c7e126c5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:45.736220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c0fd-0b70-419f-9df5-18c7e126c5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:45.737813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c0fd-0b70-419f-9df5-18c7e126c5bb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:45.749726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:45.750594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1256/2520] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:45.751156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:45.789146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ba0c3-4f2e-4d2c-ad5f-7b14ff260bfe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:45.808476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:45.808476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:45.808476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:45.808476 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] PATH_INFO: `/v3/projects/f07a6ea202534976bc49e43b7050936a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:45.808893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07a6ea202534976bc49e43b7050936a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:45.810778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:45.969522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07a6ea202534976bc49e43b7050936a', 'request_id': 'req-71f4e077-c849-401e-8456-be3a2c7c4d34'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:45.971774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:45.983902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07a6ea202534976bc49e43b7050936a', 'request_id': 'req-71f4e077-c849-401e-8456-be3a2c7c4d34'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.012633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07a6ea202534976bc49e43b7050936a', 'request_id': 'req-71f4e077-c849-401e-8456-be3a2c7c4d34'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.100344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] The token cache is being invalidate because project f07a6ea202534976bc49e43b7050936a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:46.100643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.102623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-71f4e077-c849-401e-8456-be3a2c7c4d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.106902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1265/2521] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:45 2022] DELETE /identity/v3/projects/f07a6ea202534976bc49e43b7050936a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:46.108040 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.108533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.108833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.133928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:46.135063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:46.217472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1257/2522] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:46.231939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.241000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.241294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.241999 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.243601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:46.257573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a16b24-da12-4f11-b8d9-2a570244bc3a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.275975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:46.278073 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:46.290435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.291894 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.292311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.293430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1266/2523] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:46.293585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] PATH_INFO: `/v3/projects/3e4a5173b7b14c48be41bbd685cb7e97` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.295386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.296378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4a5173b7b14c48be41bbd685cb7e97)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.299442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.305367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faacd9-ee3f-4c36-8bcc-ebb3b8e71546 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.314403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.315382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.315681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.315998 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.316742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:46.317055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.318681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.332810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1267/2524] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:46.338636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.352945 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf6981-67b9-46d6-8d0d-24321030cd12 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.360059 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.360738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.361049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.361330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.362072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.364311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.427530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4a5173b7b14c48be41bbd685cb7e97', 'request_id': 'req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.485842 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1268/2525] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:46 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:46.491455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.534697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4a5173b7b14c48be41bbd685cb7e97', 'request_id': 'req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.547231 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4a5173b7b14c48be41bbd685cb7e97', 'request_id': 'req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.571280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8db4-8fdd-4abe-bcf6-059a079f799b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.575004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] The token cache is being invalidate because project 3e4a5173b7b14c48be41bbd685cb7e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:46.575377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.576119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.581519 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1258/2526] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:46 2022] DELETE /identity/v3/projects/3e4a5173b7b14c48be41bbd685cb7e97 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:46.585852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.587352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.588069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.588352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.588636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.589343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.591290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.593121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:46.624748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:46.681297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1269/2527] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:46 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:46.683304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.687889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:46.699074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d5dc9-203f-4f53-b0cd-0ebc6f5b9cbe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.708996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.715236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.715236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.715236 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] PATH_INFO: `/v3/users/bfe65291ca724529a2109e35ad804817` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.720473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb9986-fcb6-48cd-b004-110f5e513e46 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.723269 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe65291ca724529a2109e35ad804817)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.725474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.740320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.743982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.743982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.743982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.743982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.744373 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.758630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1270/2528] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:46.762154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.775568 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf593c6-512d-4235-9b02-bea1efada1f0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.780984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.781660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.781942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.782218 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.782942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.785518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.798154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1271/2529] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:46.810544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:46.828124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b05bd-cb80-400e-ab6a-c4bfdc498bac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:46.836942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a9013-e08e-426c-895b-54c6d534c2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:46.838722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9013-e08e-426c-895b-54c6d534c2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.839087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9013-e08e-426c-895b-54c6d534c2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.839443 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a9013-e08e-426c-895b-54c6d534c2b7 admin admin] PATH_INFO: `/v3/projects/a1d96b8f56934a02a3f069227b7be1c1/users/6b822b1065c943fcb0527909704de11e/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:46.865679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a9013-e08e-426c-895b-54c6d534c2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d96b8f56934a02a3f069227b7be1c1, user_id=6b822b1065c943fcb0527909704de11e, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:46.870404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a9013-e08e-426c-895b-54c6d534c2b7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:46.961866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe65291ca724529a2109e35ad804817'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.982253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe65291ca724529a2109e35ad804817'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.992194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe65291ca724529a2109e35ad804817'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.992509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1272/2530] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:46 2022] PUT /identity/v3/projects/a1d96b8f56934a02a3f069227b7be1c1/users/6b822b1065c943fcb0527909704de11e/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:46.993130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe65291ca724529a2109e35ad804817'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:46.998932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:46.999339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:46.999927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:47.040102 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] MFA Rules not processed for user `6b822b1065c943fcb0527909704de11e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:47.041410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:47.072419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe65291ca724529a2109e35ad804817'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:47.079078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:47.092585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1259/2531] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:46 2022] DELETE /identity/v3/users/bfe65291ca724529a2109e35ad804817 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:47.152067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1273/2532] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:47.153251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:47.157157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:47.236191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8356783-cc46-40a1-aa2c-2be8d063f95e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:47.241341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:47.249976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:47.249976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:47.249976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:47.249976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:47.249976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:47.531682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1260/2533] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:47 2022] POST /identity/v3/projects => generated 381 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:47.539090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:47.603817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8361b-6d93-4e3f-b9ef-6f35a2922cfd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:47.657793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:47.659529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:47.659529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:47.659867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:47.660383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:47.662318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:47.794914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:47.799620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:47.813517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae4361-f60f-4890-9818-745d0878cc05 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:47.818489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:47.819356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:47.819644 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:47.819951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] PATH_INFO: `/v3/projects/072128bd6ffd4d088097e99f57f73745` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:47.821168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=072128bd6ffd4d088097e99f57f73745)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:47.823131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:47.836857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1274/2534] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:47 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:47.837909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:47.846715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:47.848385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11861026-7e55-453a-b168-0c702a6d265c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:47.853351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:47.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:47.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:47.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:47.856926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:47.857340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:47.868420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1275/2535] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:47.873685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:47.885053 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd7cb-2905-438e-85ec-35d70b116d3b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:47.889962 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:47.891374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:47.891374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:47.891555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] PATH_INFO: `/v3/projects/c1ac1b91ddf5479aa1c56cbbcdacc3e8/users/ba12d0c419fe4601ad907bc33ab70138/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:47.910805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ac1b91ddf5479aa1c56cbbcdacc3e8, user_id=ba12d0c419fe4601ad907bc33ab70138, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:47.913858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.029625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1276/2536] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:47 2022] PUT /identity/v3/projects/c1ac1b91ddf5479aa1c56cbbcdacc3e8/users/ba12d0c419fe4601ad907bc33ab70138/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:48.033588 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.039940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072128bd6ffd4d088097e99f57f73745', 'request_id': 'req-27dd79e1-69dc-43a1-a787-a66afaaf88dd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:48.115337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4a798-291f-42c6-9885-2439d1036fb2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.134267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072128bd6ffd4d088097e99f57f73745', 'request_id': 'req-27dd79e1-69dc-43a1-a787-a66afaaf88dd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:48.142709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072128bd6ffd4d088097e99f57f73745', 'request_id': 'req-27dd79e1-69dc-43a1-a787-a66afaaf88dd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:48.162882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] The token cache is being invalidate because project 072128bd6ffd4d088097e99f57f73745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:48.163158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:48.163846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-27dd79e1-69dc-43a1-a787-a66afaaf88dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:48.165669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1261/2537] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:47 2022] DELETE /identity/v3/projects/072128bd6ffd4d088097e99f57f73745 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:48.170291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2332f-a994-488f-aba9-247b675dcbe6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.170577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2332f-a994-488f-aba9-247b675dcbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.170877 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2332f-a994-488f-aba9-247b675dcbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.192676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9ee2332f-a994-488f-aba9-247b675dcbe6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:48.193964 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.194111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9ee2332f-a994-488f-aba9-247b675dcbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:48.194965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.195251 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.195526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.196447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.198043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.201328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:48.204732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1262/2538] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:48.212561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.213424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.213424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.224255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1277/2539] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:48.225957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.227995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:48.240794 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:48.242345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:48.246052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351732bd-e6bf-4abd-bbb0-b1458fd26c67 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.251931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1263/2540] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:48.254237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8aff-3564-4efa-9b94-e59802a07bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.255136 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8aff-3564-4efa-9b94-e59802a07bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.255787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8aff-3564-4efa-9b94-e59802a07bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.256362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8aff-3564-4efa-9b94-e59802a07bb8 admin admin] PATH_INFO: `/v3/projects/c1ac1b91ddf5479aa1c56cbbcdacc3e8/users/ba12d0c419fe4601ad907bc33ab70138/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.265746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.265915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d8aff-3564-4efa-9b94-e59802a07bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ac1b91ddf5479aa1c56cbbcdacc3e8, user_id=ba12d0c419fe4601ad907bc33ab70138, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.265915 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d8aff-3564-4efa-9b94-e59802a07bb8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.269167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94214fc7-278a-41ff-96d4-602a96e722ae None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.276745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1278/2541] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:48 2022] PUT /identity/v3/projects/c1ac1b91ddf5479aa1c56cbbcdacc3e8/users/ba12d0c419fe4601ad907bc33ab70138/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:48.289440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.289821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.290495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.321764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] MFA Rules not processed for user `ba12d0c419fe4601ad907bc33ab70138`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:48.323208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:48.359944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.360624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.360940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.362517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.362690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:48.362966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.364974 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.383546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1264/2542] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:48.384555 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.397371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc9f5-3a02-4f6b-9234-4cef19d31f43 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.402547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.403415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.403912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.404316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.405045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.407008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.415849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1279/2543] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:48.428038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.429457 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:48.497853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:48.505324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb86352-8653-4d21-81a7-0b1a52085e83 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.509674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.510435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.510810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.511166 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.513489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:48.522213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1265/2544] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:48 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:48.526402 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.589011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.590548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.605056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1280/2545] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:48.617954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6abc1-8738-42f5-832d-84a18b51cba6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.623405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.624108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.624394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.624675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.625375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.628157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.639512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:48.708875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1266/2546] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:48 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:48.712471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.724512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdd68f-bd09-43db-aaf8-0bdaced12857 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.729622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.730496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.730855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.731228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.732130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.734080 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.748840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1281/2547] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:21:48.753536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.764003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163fa80-5f3a-4d03-ab0e-285551c1eec3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.769485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e03d56-3442-4156-843f-7db05667a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.770223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e03d56-3442-4156-843f-7db05667a161 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.770583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e03d56-3442-4156-843f-7db05667a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.770934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e03d56-3442-4156-843f-7db05667a161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.771828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e03d56-3442-4156-843f-7db05667a161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.773540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e03d56-3442-4156-843f-7db05667a161 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:48.789436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1267/2548] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:48.790747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:48.805576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124167e-ac38-490a-ba7b-d532314b1958 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:48.811756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:48.813376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:48.814326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:48.815005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] PATH_INFO: `/v3/projects/37d971c7a3b1423f9c2f8907dfcaeaaa/users/9d8e31c6c5d24bf89b60ae6fab55068c/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:48.837353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d971c7a3b1423f9c2f8907dfcaeaaa, user_id=9d8e31c6c5d24bf89b60ae6fab55068c, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:48.842027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.092905 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1282/2549] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:48 2022] PUT /identity/v3/projects/37d971c7a3b1423f9c2f8907dfcaeaaa/users/9d8e31c6c5d24bf89b60ae6fab55068c/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:49.104305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.104596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.104878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.134876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] MFA Rules not processed for user `9d8e31c6c5d24bf89b60ae6fab55068c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:49.143034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:49.201621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1268/2550] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:49.205811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:49.282635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502bc0-bf43-41a5-8bdc-a9b10dcffe00 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:49.287598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:49.288374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.288664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.288942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.289649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:49.291819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.423056 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1283/2551] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:49 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:21:49.428008 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:49.445452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93084d2-fa2f-4709-94d2-bfa6bfbd89b2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:49.506514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:49.507277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.507636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.508012 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.508775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:49.510836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.672446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1269/2552] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:49 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:49.676830 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:49.687104 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada154c-8360-4719-a9a1-1f3e2dba4123 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:49.692177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:49.692834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.693119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.693396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.694116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:49.695711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.706082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1284/2553] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:49.711249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:49.721340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa24971-b232-4867-b57e-f8598611c337 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:49.726121 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:49.727020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.727305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.727582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] PATH_INFO: `/v3/projects/760b06c717454eadad6070393182136c/users/4e7e6f74c18644629a07033bb5f12869/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.742101 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760b06c717454eadad6070393182136c, user_id=4e7e6f74c18644629a07033bb5f12869, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:49.744851 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.848512 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1270/2554] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:49 2022] PUT /identity/v3/projects/760b06c717454eadad6070393182136c/users/4e7e6f74c18644629a07033bb5f12869/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:49.852547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:49.862473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a09ae-9cbf-405d-bcf4-376ffed19beb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:49.902181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:49.920850 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06278208-3eae-493a-8abf-39365780319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:49.921481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06278208-3eae-493a-8abf-39365780319c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.921764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06278208-3eae-493a-8abf-39365780319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.922038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06278208-3eae-493a-8abf-39365780319c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.922762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06278208-3eae-493a-8abf-39365780319c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:49.924447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06278208-3eae-493a-8abf-39365780319c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.934333 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1285/2555] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:49.938569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:49.949484 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ca524-6e15-49e3-bd84-70ff6ae8f018 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:49.954073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:49.954944 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.955230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.955508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] PATH_INFO: `/v3/projects/760b06c717454eadad6070393182136c/users/4e7e6f74c18644629a07033bb5f12869/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:49.958335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=760b06c717454eadad6070393182136c, user_id=4e7e6f74c18644629a07033bb5f12869, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:49.961401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:49.972517 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1271/2556] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:49 2022] PUT /identity/v3/projects/760b06c717454eadad6070393182136c/users/4e7e6f74c18644629a07033bb5f12869/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:49.983938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:49.984235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:49.984611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:50.012287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] MFA Rules not processed for user `4e7e6f74c18644629a07033bb5f12869`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:50.013496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:50.082067 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1286/2557] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:50.093388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:50.095113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:50.126939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:50.154153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a22dc-ed31-44e0-84da-a1e9d0a6f62a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:50.163532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39fedd-37b0-4e21-b962-cdbedd95c65f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:50.163532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fedd-37b0-4e21-b962-cdbedd95c65f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:50.163532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fedd-37b0-4e21-b962-cdbedd95c65f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:50.163532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39fedd-37b0-4e21-b962-cdbedd95c65f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:50.168325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fedd-37b0-4e21-b962-cdbedd95c65f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:50.169789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39fedd-37b0-4e21-b962-cdbedd95c65f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:50.179776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1272/2558] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:50.756789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:50.820278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e642-ff23-425a-981a-dd40db8c0f2a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:50.824857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:50.825720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:50.825999 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:50.826273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] PATH_INFO: `/v3/users/9d8e31c6c5d24bf89b60ae6fab55068c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:50.827471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8e31c6c5d24bf89b60ae6fab55068c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:50.829419 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:50.998227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8e31c6c5d24bf89b60ae6fab55068c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.009194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:51.010601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8e31c6c5d24bf89b60ae6fab55068c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.011278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8e31c6c5d24bf89b60ae6fab55068c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.088763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8e31c6c5d24bf89b60ae6fab55068c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.089430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8e31c6c5d24bf89b60ae6fab55068c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.102608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1287/2559] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:50 2022] DELETE /identity/v3/users/9d8e31c6c5d24bf89b60ae6fab55068c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:51.107125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:51.107621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:51.107719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:51.125053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:51.126298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:51.190222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1273/2560] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:51.200614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:51.202046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:51.259247 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284db474-0810-4409-920e-aea23ef927e4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:51.262885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:51.263539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:51.263853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:51.264141 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:51.276841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:51.276841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:51.286924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1288/2561] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:51.718613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:51.720125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:51.732784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796055de-5ed1-4427-81f8-b2995df199cc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:51.737394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:51.738764 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:51.739048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:51.739326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] PATH_INFO: `/v3/projects/37d971c7a3b1423f9c2f8907dfcaeaaa` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:51.740503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d971c7a3b1423f9c2f8907dfcaeaaa)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:51.742593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:51.872696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d971c7a3b1423f9c2f8907dfcaeaaa', 'request_id': 'req-4ac2208f-9456-4a18-bf53-9204e21d9b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.960333 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d971c7a3b1423f9c2f8907dfcaeaaa', 'request_id': 'req-4ac2208f-9456-4a18-bf53-9204e21d9b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.967504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d971c7a3b1423f9c2f8907dfcaeaaa', 'request_id': 'req-4ac2208f-9456-4a18-bf53-9204e21d9b57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.978411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] The token cache is being invalidate because project 37d971c7a3b1423f9c2f8907dfcaeaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:51.978696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.979345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:51.980910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1274/2562] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:51 2022] DELETE /identity/v3/projects/37d971c7a3b1423f9c2f8907dfcaeaaa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:51.985601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:51.997173 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51889a4a-1c29-48a8-b6d5-7c9a43191f46 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:52.061634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:52.062510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:52.062794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:52.063072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] PATH_INFO: `/v3/users/4e7e6f74c18644629a07033bb5f12869` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:52.064317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7e6f74c18644629a07033bb5f12869)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:52.066285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:52.230142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7e6f74c18644629a07033bb5f12869'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:52.242791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7e6f74c18644629a07033bb5f12869'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:52.243492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7e6f74c18644629a07033bb5f12869'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:52.319855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7e6f74c18644629a07033bb5f12869'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:52.320483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f0cc8f3b-5411-4a26-886c-c5634243689d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7e6f74c18644629a07033bb5f12869'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:52.336819 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1289/2563] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:51 2022] DELETE /identity/v3/users/4e7e6f74c18644629a07033bb5f12869 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:52.776594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:52.778180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:52.793083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2208f-9456-4a18-bf53-9204e21d9b57 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:52.854860 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:52.870462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:52.871588 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:52.871910 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:52.872194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] PATH_INFO: `/v3/projects/760b06c717454eadad6070393182136c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:52.873620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760b06c717454eadad6070393182136c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:52.875891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.001696 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760b06c717454eadad6070393182136c', 'request_id': 'req-7bdb1186-9c85-4b43-b610-d634bc426336'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:53.077398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760b06c717454eadad6070393182136c', 'request_id': 'req-7bdb1186-9c85-4b43-b610-d634bc426336'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:53.086801 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760b06c717454eadad6070393182136c', 'request_id': 'req-7bdb1186-9c85-4b43-b610-d634bc426336'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:53.098786 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] The token cache is being invalidate because project 760b06c717454eadad6070393182136c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:53.099075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:53.100180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7bdb1186-9c85-4b43-b610-d634bc426336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:53.101433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1275/2564] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:52 2022] DELETE /identity/v3/projects/760b06c717454eadad6070393182136c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:53.106285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.106788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.106901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.113262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:53.125455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:53.126665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:53.186806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1290/2565] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:53.194466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.194760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.195044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.213872 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:53.215082 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:53.223192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1276/2566] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:53.227380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.237342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522ea5-7254-4eb0-a913-cffd7e1dc9ce None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.242749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.243450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.243728 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.244055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.244782 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:53.245087 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.246704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.264230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1291/2567] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:21:53.265139 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.275198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dad1c-bbea-4317-9493-bfb19202e1f5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.279952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.280609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.280900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.281178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.281862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.283803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.372703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1277/2568] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:53 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:53.376619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.386494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497724f-66b2-4873-8b5d-50e882a5be66 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.442459 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.443133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.443415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.443693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.444513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.446416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.548680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1292/2569] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:53 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:53.553632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.564292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899fcda-9008-49c5-8a7e-0506b7f3d314 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.568981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.570030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.570030 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.570267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.570954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.572693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.583045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1278/2570] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:53.587230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.597672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b253d-4b39-40b6-918a-69b7885e82a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.602256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594c5e0-10f3-4e83-97a5-6e2469db7cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.602910 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c5e0-10f3-4e83-97a5-6e2469db7cec admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.603199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c5e0-10f3-4e83-97a5-6e2469db7cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.603471 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c5e0-10f3-4e83-97a5-6e2469db7cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.604233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594c5e0-10f3-4e83-97a5-6e2469db7cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.605812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594c5e0-10f3-4e83-97a5-6e2469db7cec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.616766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1293/2571] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:53.620971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.631536 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53477bd-4ba3-498c-96c6-ee60d374a0db admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.636222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.637265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.637546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.637822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] PATH_INFO: `/v3/projects/54d9f47b4b8c44cebcd8c69ce4186655/users/f4df511968734b658a3bc1ac34f5d591/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.652604 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d9f47b4b8c44cebcd8c69ce4186655, user_id=f4df511968734b658a3bc1ac34f5d591, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.655347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:53.772952 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1279/2572] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:53 2022] PUT /identity/v3/projects/54d9f47b4b8c44cebcd8c69ce4186655/users/f4df511968734b658a3bc1ac34f5d591/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:53.784181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.785090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.785430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.812881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] MFA Rules not processed for user `f4df511968734b658a3bc1ac34f5d591`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:53.814095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:53.879000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:53.884450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1294/2573] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:53.889079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:53.974918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5c23-7333-477c-9f1e-426455dff378 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:53.981380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:53.981380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:53.981380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:53.981380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:53.981754 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:53.983558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.043122 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.044551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:54.068037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1280/2574] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:53 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:54.070038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.080920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:54.111164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec4d72-ada7-4074-b3cf-cd3945c76e38 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.147214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ca7b-cba7-47a6-8852-5fd5c85c5146 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.152715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.153449 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.153728 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.154000 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.154716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.156818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.164883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.165542 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.165827 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.166107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.168084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:54.230262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.231710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.236346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1281/2575] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:54 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:54.237325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.241818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1295/2576] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:54.247326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038dac6-a068-4941-8961-c3166456b866 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.252229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.267200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.267200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.267200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.267200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.267200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.267200 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1282/2577] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:54.271020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.281735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3acd2-7e20-4954-9080-2e1d7473a742 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.287454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223641-b39c-47ee-be4a-6fe18398c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.288387 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223641-b39c-47ee-be4a-6fe18398c30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.288676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223641-b39c-47ee-be4a-6fe18398c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.288955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223641-b39c-47ee-be4a-6fe18398c30e admin admin] PATH_INFO: `/v3/projects/204b653718ca42709816da2578bbb5f5/users/6f9d33310b91421b8479a08f1ecdc4b4/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.304960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223641-b39c-47ee-be4a-6fe18398c30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=204b653718ca42709816da2578bbb5f5, user_id=6f9d33310b91421b8479a08f1ecdc4b4, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.307918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223641-b39c-47ee-be4a-6fe18398c30e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.412485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1296/2578] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:54 2022] PUT /identity/v3/projects/204b653718ca42709816da2578bbb5f5/users/6f9d33310b91421b8479a08f1ecdc4b4/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:54.416323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.427179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd057-cfde-4a7c-beb1-6d0bb0d17a45 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.471212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390d27-802f-4b65-a1a8-9ec165886e70 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.471491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390d27-802f-4b65-a1a8-9ec165886e70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.473199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4390d27-802f-4b65-a1a8-9ec165886e70 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.476669 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1297/2579] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:21:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:21:54.484483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.484840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.485197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.494369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.498078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.498078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.498078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.498078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.498078 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.511977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1283/2580] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:54.513110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.529034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:54.530318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:54.533761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f403-48b5-4999-81a8-5f8af772a85e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.539477 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c31dc-d919-4b92-a802-790c092b29c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.540416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c31dc-d919-4b92-a802-790c092b29c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.540693 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c31dc-d919-4b92-a802-790c092b29c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.540977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c31dc-d919-4b92-a802-790c092b29c5 admin admin] PATH_INFO: `/v3/projects/204b653718ca42709816da2578bbb5f5/users/6f9d33310b91421b8479a08f1ecdc4b4/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.546925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c31dc-d919-4b92-a802-790c092b29c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204b653718ca42709816da2578bbb5f5, user_id=6f9d33310b91421b8479a08f1ecdc4b4, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.546925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c31dc-d919-4b92-a802-790c092b29c5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.553891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:54.557716 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1284/2581] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:54 2022] PUT /identity/v3/projects/204b653718ca42709816da2578bbb5f5/users/6f9d33310b91421b8479a08f1ecdc4b4/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:21:54.568977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.570189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.570189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.606131 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1298/2582] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:54.608534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] MFA Rules not processed for user `6f9d33310b91421b8479a08f1ecdc4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:54.609931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:54.620450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.621909 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:54.663003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:54.680208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae166a41-a7d7-4ab5-9588-5f74b8641dee None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.680432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1285/2583] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:54.692194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.693548 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:54.733410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8ccf1-bbda-4f4e-b1c9-a928b32400f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.734069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8ccf1-bbda-4f4e-b1c9-a928b32400f5 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.734354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8ccf1-bbda-4f4e-b1c9-a928b32400f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.734631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8ccf1-bbda-4f4e-b1c9-a928b32400f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.752563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43116ae-39e7-4aca-abaa-6ebbf6a98920 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.756854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.757529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.757833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.758110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:54.767053 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.768562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.778655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1286/2584] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:54.803439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8ccf1-bbda-4f4e-b1c9-a928b32400f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:54.804928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8ccf1-bbda-4f4e-b1c9-a928b32400f5 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:54.816228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1299/2585] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:21:54.923868 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:54.932967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9c9d-02e5-45ff-aaa4-fc204685f897 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:54.937441 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c1f5-21af-4945-b8ce-e4fbc604cd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:54.938205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c1f5-21af-4945-b8ce-e4fbc604cd33 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:54.938497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c1f5-21af-4945-b8ce-e4fbc604cd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:54.938792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c1f5-21af-4945-b8ce-e4fbc604cd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.000550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c1f5-21af-4945-b8ce-e4fbc604cd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:55.002061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c1f5-21af-4945-b8ce-e4fbc604cd33 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:55.014677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1287/2586] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:55.047477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f898e-6e92-4e74-8d8e-624568d27900 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.048109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f898e-6e92-4e74-8d8e-624568d27900 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.048109 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f898e-6e92-4e74-8d8e-624568d27900 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.050231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1300/2587] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:21:55.057066 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284842f7-d5a2-4bb9-83ee-5c3747456e7d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.057358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284842f7-d5a2-4bb9-83ee-5c3747456e7d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.057638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284842f7-d5a2-4bb9-83ee-5c3747456e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.098010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-284842f7-d5a2-4bb9-83ee-5c3747456e7d None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:55.099223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-284842f7-d5a2-4bb9-83ee-5c3747456e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:55.155083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1288/2588] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:55.167840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f898e-6e92-4e74-8d8e-624568d27900 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:55.169916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-812f898e-6e92-4e74-8d8e-624568d27900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:55.183486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f898e-6e92-4e74-8d8e-624568d27900 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:55.187734 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49b4cd-3c15-43c4-bde6-e6f18c2fa074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:55.188603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49b4cd-3c15-43c4-bde6-e6f18c2fa074 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.188950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49b4cd-3c15-43c4-bde6-e6f18c2fa074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.189339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49b4cd-3c15-43c4-bde6-e6f18c2fa074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.198939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49b4cd-3c15-43c4-bde6-e6f18c2fa074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:55.198939 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49b4cd-3c15-43c4-bde6-e6f18c2fa074 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:55.207270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1301/2589] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:55.296158 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61f898-6d00-4737-9903-6a741446d63c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.296482 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61f898-6d00-4737-9903-6a741446d63c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.296771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61f898-6d00-4737-9903-6a741446d63c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.298295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1289/2590] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:21:55.304733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.305044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.305325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.311666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:55.325142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:55.326363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:55.336158 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1302/2591] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:55.347326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61f898-6d00-4737-9903-6a741446d63c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:55.348822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b61f898-6d00-4737-9903-6a741446d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:55.366172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61f898-6d00-4737-9903-6a741446d63c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:55.369938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969ff9-d1aa-4501-9d68-849712007e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:55.370642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969ff9-d1aa-4501-9d68-849712007e7c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.375277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969ff9-d1aa-4501-9d68-849712007e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.375277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969ff9-d1aa-4501-9d68-849712007e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.382781 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969ff9-d1aa-4501-9d68-849712007e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:55.384276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969ff9-d1aa-4501-9d68-849712007e7c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:55.395245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1290/2592] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:55.507082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:55.582330 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaeccb-e9b2-4a8b-8f30-feef6f537d5e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:55.588058 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:55.589171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.589547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.589832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] PATH_INFO: `/v3/users/f4df511968734b658a3bc1ac34f5d591` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.591075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4df511968734b658a3bc1ac34f5d591)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:55.593289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:55.825448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4df511968734b658a3bc1ac34f5d591'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:55.838382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4df511968734b658a3bc1ac34f5d591'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:55.839017 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4df511968734b658a3bc1ac34f5d591'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:55.920038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4df511968734b658a3bc1ac34f5d591'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:55.920636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4df511968734b658a3bc1ac34f5d591'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:55.934455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1303/2593] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:55 2022] DELETE /identity/v3/users/f4df511968734b658a3bc1ac34f5d591 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:55.938901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:55.939395 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:55.939496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:55.957989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:55.959207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:55.968576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:56.021069 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1291/2594] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:56.031338 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:56.033248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:56.097746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d20958-64b6-40df-a438-05c9ec836fe5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:56.103105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:56.103105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:56.103105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:56.103105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:56.112911 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:56.114491 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:56.125025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1304/2595] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:56.542229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:56.544172 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:56.558403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b64ec-92f3-4ae6-acf9-7ba377b8099b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:56.565408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:56.565408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:56.565408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:56.565408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] PATH_INFO: `/v3/projects/54d9f47b4b8c44cebcd8c69ce4186655` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:56.566209 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d9f47b4b8c44cebcd8c69ce4186655)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:56.568639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:56.678732 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d9f47b4b8c44cebcd8c69ce4186655', 'request_id': 'req-7aac69f4-81b5-409e-bd7c-189d463ff001'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:56.769307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d9f47b4b8c44cebcd8c69ce4186655', 'request_id': 'req-7aac69f4-81b5-409e-bd7c-189d463ff001'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:56.776319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d9f47b4b8c44cebcd8c69ce4186655', 'request_id': 'req-7aac69f4-81b5-409e-bd7c-189d463ff001'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:56.789444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] The token cache is being invalidate because project 54d9f47b4b8c44cebcd8c69ce4186655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:56.789775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:56.790442 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:56.792031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1292/2596] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:56 2022] DELETE /identity/v3/projects/54d9f47b4b8c44cebcd8c69ce4186655 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:56.796038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:56.806332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39a0b-4d54-4cc9-8c38-49d9d9e7a604 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:56.820520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:56.865647 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:56.866519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:56.866800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:56.867070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] PATH_INFO: `/v3/users/6f9d33310b91421b8479a08f1ecdc4b4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:56.868298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9d33310b91421b8479a08f1ecdc4b4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:56.870250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:57.124572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9d33310b91421b8479a08f1ecdc4b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.138791 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9d33310b91421b8479a08f1ecdc4b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.139493 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9d33310b91421b8479a08f1ecdc4b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.236526 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9d33310b91421b8479a08f1ecdc4b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.237144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a1f5fee7-d645-4b5b-b93c-087d049506fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9d33310b91421b8479a08f1ecdc4b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.249940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1305/2597] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:56 2022] DELETE /identity/v3/users/6f9d33310b91421b8479a08f1ecdc4b4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:57.661931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:57.663483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:57.680010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac69f4-81b5-409e-bd7c-189d463ff001 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:57.744284 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:57.745153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:57.745439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:57.745717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] PATH_INFO: `/v3/projects/204b653718ca42709816da2578bbb5f5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:57.746932 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204b653718ca42709816da2578bbb5f5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:57.748914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:57.894358 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:57.901928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204b653718ca42709816da2578bbb5f5', 'request_id': 'req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.971120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204b653718ca42709816da2578bbb5f5', 'request_id': 'req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:57.990446 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204b653718ca42709816da2578bbb5f5', 'request_id': 'req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:58.002337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] The token cache is being invalidate because project 204b653718ca42709816da2578bbb5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:21:58.002627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:58.003307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fd9c3f90-0ad0-45ea-8fee-53da1ec3f4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:58.005615 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1293/2598] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:57 2022] DELETE /identity/v3/projects/204b653718ca42709816da2578bbb5f5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:58.010901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.011371 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.011469 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.029746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:58.031079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:58.093756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1306/2599] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:58.102177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.102524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.102852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.121998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:58.123214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:58.131102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1294/2600] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:58.135219 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.144614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba068f-af73-4528-b8b0-f62588744e7f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.149223 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.149901 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.150164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.150439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.151170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:21:58.151473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.153134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.165777 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1307/2601] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:21:58.170109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.180776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a901-0622-4423-a21b-4c310c5c6e04 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.185598 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.186359 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.186743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.187013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.187821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.189812 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.295511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1295/2602] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:21:58 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:58.299657 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.309631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c792ea1-5a50-400d-8a8d-5e1727e1bcdf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.329510 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:58.368546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.369221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.369513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.369792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.370528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.372550 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.481928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1308/2603] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:21:58 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:21:58.486503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.496842 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7564e9d-8872-4777-b78e-2bc785ad38b8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.501676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.502327 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.502609 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.502885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.503652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.505375 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.516241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1296/2604] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:58.521164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.531496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f765c-b4d0-450f-b64d-129adaa3b6b0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.536954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578689c-1cb1-4a20-8b00-46605527933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.537623 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578689c-1cb1-4a20-8b00-46605527933f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.537913 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578689c-1cb1-4a20-8b00-46605527933f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.538196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578689c-1cb1-4a20-8b00-46605527933f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.539003 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578689c-1cb1-4a20-8b00-46605527933f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.540675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578689c-1cb1-4a20-8b00-46605527933f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.552138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1309/2605] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:21:58.556348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.566292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4551-28f8-4f6c-add1-250327b8e2dd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.570891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.571768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.572077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.572364 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] PATH_INFO: `/v3/projects/a61a83b22da84170a955b09440c93627/users/d4fb58f7119b4c0aac18dad9c9013817/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.588439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61a83b22da84170a955b09440c93627, user_id=d4fb58f7119b4c0aac18dad9c9013817, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.591246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.655116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1297/2606] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:21:58 2022] PUT /identity/v3/projects/a61a83b22da84170a955b09440c93627/users/d4fb58f7119b4c0aac18dad9c9013817/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:58.666980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.667366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.667839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.696433 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] MFA Rules not processed for user `d4fb58f7119b4c0aac18dad9c9013817`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:58.697656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:58.763417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1310/2607] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:58.775279 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.776989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:58.839733 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcc8f5-1374-44d4-9da4-b7755a6621db admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.843476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9852b1-669c-4016-95c2-855f8e108497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.844154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9852b1-669c-4016-95c2-855f8e108497 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.844440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9852b1-669c-4016-95c2-855f8e108497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.844717 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9852b1-669c-4016-95c2-855f8e108497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.854074 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9852b1-669c-4016-95c2-855f8e108497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.855547 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9852b1-669c-4016-95c2-855f8e108497 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:58.864862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1298/2608] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:58.884856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:58.955002 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0431b-55b2-4e84-a57c-81e8aceebb62 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:58.960807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:58.961822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:58.962108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:58.962383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] PATH_INFO: `/v3/users/d4fb58f7119b4c0aac18dad9c9013817` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:58.963610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fb58f7119b4c0aac18dad9c9013817)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:58.965572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:59.167764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:59.177733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fb58f7119b4c0aac18dad9c9013817'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:59.189783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fb58f7119b4c0aac18dad9c9013817'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:59.190543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fb58f7119b4c0aac18dad9c9013817'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:59.272694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fb58f7119b4c0aac18dad9c9013817'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:59.273402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fb58f7119b4c0aac18dad9c9013817'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:21:59.286094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1311/2609] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:21:58 2022] DELETE /identity/v3/users/d4fb58f7119b4c0aac18dad9c9013817 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:21:59.290627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3402e-9bee-4b38-bbc5-0627974d9f68 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:59.290896 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3402e-9bee-4b38-bbc5-0627974d9f68 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:59.291187 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3402e-9bee-4b38-bbc5-0627974d9f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:59.309081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0de3402e-9bee-4b38-bbc5-0627974d9f68 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:59.310310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0de3402e-9bee-4b38-bbc5-0627974d9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:59.371541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1299/2610] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:21:59.382424 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:59.383932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:59.444704 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c5418-188d-43b0-b280-b41ec1ac08bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:59.448189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:59.449095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:59.449380 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:59.449604 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:59.455542 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:59.455977 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:59.456340 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:59.460277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:59.461725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:59.471415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1312/2611] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:21:59.478954 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:21:59.480252 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:59.484645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:59.537174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1300/2612] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:21:59.550981 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:59.552756 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:59.623186 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391456e-7335-4f33-9f94-0d0eb23548c5 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:59.628288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2f768-38a2-4e6b-9554-1c8c12ee027b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:59.629014 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f768-38a2-4e6b-9554-1c8c12ee027b service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:59.629376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f768-38a2-4e6b-9554-1c8c12ee027b service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:59.629663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2f768-38a2-4e6b-9554-1c8c12ee027b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:59.638022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f768-38a2-4e6b-9554-1c8c12ee027b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:59.639629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec2f768-38a2-4e6b-9554-1c8c12ee027b service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:21:59.648523 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1313/2613] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:21:59.889240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:21:59.889240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:21:59.920505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de28066-3ad8-4012-ae90-1dfd3a8a2dc9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:21:59.934790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:21:59.936619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:21:59.937357 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:21:59.937989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] PATH_INFO: `/v3/projects/a61a83b22da84170a955b09440c93627` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:21:59.940823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61a83b22da84170a955b09440c93627)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:21:59.943497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:00.094552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61a83b22da84170a955b09440c93627', 'request_id': 'req-043a60b2-2c71-4519-b56a-2978c37bdc4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.162390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61a83b22da84170a955b09440c93627', 'request_id': 'req-043a60b2-2c71-4519-b56a-2978c37bdc4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.170792 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61a83b22da84170a955b09440c93627', 'request_id': 'req-043a60b2-2c71-4519-b56a-2978c37bdc4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.184317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] The token cache is being invalidate because project a61a83b22da84170a955b09440c93627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:22:00.184611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.185324 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.193468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1301/2614] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:21:59 2022] DELETE /identity/v3/projects/a61a83b22da84170a955b09440c93627 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:00.193628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625758ee-ae71-4424-a0e3-979a74cc609c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.193628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625758ee-ae71-4424-a0e3-979a74cc609c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.193628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625758ee-ae71-4424-a0e3-979a74cc609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.215824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-625758ee-ae71-4424-a0e3-979a74cc609c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:00.217492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-625758ee-ae71-4424-a0e3-979a74cc609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:00.311674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.313914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:00.328950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:00.375403 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1314/2615] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:00.383784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.384314 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.384600 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.427828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a60b2-2c71-4519-b56a-2978c37bdc4c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:00.429417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:00.434165 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:00.435264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.435682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.436003 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] PATH_INFO: `/v3/users/6b822b1065c943fcb0527909704de11e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.437307 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b822b1065c943fcb0527909704de11e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:00.437452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:00.439537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:00.458882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1315/2616] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:22:00.463991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.479163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2226d9-153c-4ab0-b32a-a6f42d4b36d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:00.485749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:00.486454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.486920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.487256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.488944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:22:00.489401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:00.490991 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:00.505111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1316/2617] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:22:00.509227 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.525549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63682119-73e4-417c-a992-9c181ac0dac2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:00.532092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:00.532840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.533078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.533357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.534194 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:00.536455 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:00.637626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1317/2618] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:22:00 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:22:00.638497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.692365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:00.702508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b822b1065c943fcb0527909704de11e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.723678 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b822b1065c943fcb0527909704de11e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.725808 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b822b1065c943fcb0527909704de11e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.727404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b822b1065c943fcb0527909704de11e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.730577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce6ddd-4bb7-42d8-890c-7d14f378b822 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:00.736000 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:00.737055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.737538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.738070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.739028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:00.741301 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:00.788382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7dcd3cbb-df21-4b8b-86aa-ba23dc338806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b822b1065c943fcb0527909704de11e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:00.805350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1302/2619] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:22:00 2022] DELETE /identity/v3/users/6b822b1065c943fcb0527909704de11e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:00.807028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.807326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.807874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.824454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1318/2620] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:22:00 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:00.826250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.829874 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:00.837489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:00.838846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:00.855766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09fcb-817f-4987-b782-843e562bc33e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:00.924725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1303/2621] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:00.937403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.939666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:00.949646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:00.950362 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.950662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.951675 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.952432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:00.954233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:00.969179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1319/2622] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:00.970090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:00.991824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7a66-3086-4d43-9a75-10ec803a90bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:00.997197 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:00.998144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:00.998144 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:00.998411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:00.999140 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:01.000781 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:01.015572 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1320/2623] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:01.016530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:01.026242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960248-1586-42cc-8f92-ff7303e2cce0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:01.034996 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd3f9-52c9-4b7f-9770-6ac441b07b32 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:01.035911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be177f-c9db-4513-8f74-5d8395e079c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:01.036699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be177f-c9db-4513-8f74-5d8395e079c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:01.037079 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be177f-c9db-4513-8f74-5d8395e079c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:01.037474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be177f-c9db-4513-8f74-5d8395e079c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:01.048832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:01.050594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:01.050986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:01.051416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] PATH_INFO: `/v3/projects/2818929861c14c179c65d4ea110697ff/users/0eb87dacc0b9495bbac46448438ea3db/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:01.052881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be177f-c9db-4513-8f74-5d8395e079c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:01.054352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be177f-c9db-4513-8f74-5d8395e079c0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:01.075365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1304/2624] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:01.087410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2818929861c14c179c65d4ea110697ff, user_id=0eb87dacc0b9495bbac46448438ea3db, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:01.090384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:01.092944 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:01.210893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1321/2625] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:01 2022] PUT /identity/v3/projects/2818929861c14c179c65d4ea110697ff/users/0eb87dacc0b9495bbac46448438ea3db/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:01.223091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:01.223457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:01.223848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:01.257751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] MFA Rules not processed for user `0eb87dacc0b9495bbac46448438ea3db`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:01.259286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:01.322141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:01.344661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1305/2626] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:01.356557 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:01.358364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:01.437650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cb2b5-e3bb-4149-9c90-f9d8fb068df2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:01.443448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:01.444422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:01.444907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:01.445185 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:01.460496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:01.462133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:01.478410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1322/2627] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:01.671081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:01.672906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:01.811768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55132e4-d4be-4f15-b0f0-90c175a98b28 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:01.817897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:01.819206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:01.819498 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:01.819769 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] PATH_INFO: `/v3/projects/a1d96b8f56934a02a3f069227b7be1c1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:01.821045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d96b8f56934a02a3f069227b7be1c1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:01.823759 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:01.942286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d96b8f56934a02a3f069227b7be1c1', 'request_id': 'req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.025394 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d96b8f56934a02a3f069227b7be1c1', 'request_id': 'req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.033104 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d96b8f56934a02a3f069227b7be1c1', 'request_id': 'req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.047321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] The token cache is being invalidate because project a1d96b8f56934a02a3f069227b7be1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:22:02.047660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.048387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.052265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1306/2628] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:22:01 2022] DELETE /identity/v3/projects/a1d96b8f56934a02a3f069227b7be1c1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:02.054747 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:02.072497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873fec9-8246-476c-a420-0730123b935b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:02.154598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:02.155488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:02.155775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:02.156082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] PATH_INFO: `/v3/users/ba12d0c419fe4601ad907bc33ab70138` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:02.157363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba12d0c419fe4601ad907bc33ab70138)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:02.159886 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:02.429169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba12d0c419fe4601ad907bc33ab70138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.464839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba12d0c419fe4601ad907bc33ab70138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.465881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba12d0c419fe4601ad907bc33ab70138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.537231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba12d0c419fe4601ad907bc33ab70138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.538407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-adfaad82-bb36-4d13-b92f-3c017516364c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba12d0c419fe4601ad907bc33ab70138'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:02.556682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1323/2629] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:22:02 2022] DELETE /identity/v3/users/ba12d0c419fe4601ad907bc33ab70138 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:03.332893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:03.340424 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:03.354564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0d5bc-8d4d-44cb-8829-7ee659e754ef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:03.459247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:03.460564 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:03.460790 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:03.461671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] PATH_INFO: `/v3/projects/c1ac1b91ddf5479aa1c56cbbcdacc3e8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:03.463346 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ac1b91ddf5479aa1c56cbbcdacc3e8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:03.468049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:03.501474 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:03.600329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ac1b91ddf5479aa1c56cbbcdacc3e8', 'request_id': 'req-c5ab8534-630c-4b41-9282-371249367b04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:03.691655 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ac1b91ddf5479aa1c56cbbcdacc3e8', 'request_id': 'req-c5ab8534-630c-4b41-9282-371249367b04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:03.699353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ac1b91ddf5479aa1c56cbbcdacc3e8', 'request_id': 'req-c5ab8534-630c-4b41-9282-371249367b04'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:03.714852 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] The token cache is being invalidate because project c1ac1b91ddf5479aa1c56cbbcdacc3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:22:03.715183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:03.715898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c5ab8534-630c-4b41-9282-371249367b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:03.718119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1307/2630] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:22:03 2022] DELETE /identity/v3/projects/c1ac1b91ddf5479aa1c56cbbcdacc3e8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:03.730021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:03.730608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:03.730919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:03.757287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:03.757287 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:03.770765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:03.835701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1324/2631] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:03.848485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:03.849014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:03.849569 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:03.887425 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:03.889495 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:03.899998 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1308/2632] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:03.906112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:03.917449 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352fc83-aa50-4777-87ed-56f8ae7cccd2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:03.926061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:03.926736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:03.927201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:03.927481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:03.928304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:22:03.928616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:03.930785 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:03.947354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1325/2633] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:22:03.952766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:03.964782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf9f3f-f1a9-42ee-a9f4-ba66c9d4f02a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:03.969882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:03.970739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:03.971026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:03.971351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:03.972835 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:03.974774 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:04.727957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1309/2634] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:22:03 2022] POST /identity/v3/projects => generated 359 bytes in 776 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:04.732811 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:04.747397 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d2cf8-a880-446a-a21e-0d1e74c19e4e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:04.822165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:04.823125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:04.823413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:04.823726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:04.824581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:04.826664 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:04.918565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1326/2635] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:22:04 2022] POST /identity/v3/users => generated 280 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:04.922970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:04.935004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696bda1-ec09-45d9-bff7-7cb058b78fb3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:04.941213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:04.942148 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:04.942435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:04.942721 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:04.943459 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:04.945145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:04.957439 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1310/2636] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:04.961997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:04.973189 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d3579-bef0-40d8-880a-8f9c2ef5c641 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:04.978315 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73aeda-1bd0-49d3-adf0-960afe257087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:04.978990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73aeda-1bd0-49d3-adf0-960afe257087 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:04.979275 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73aeda-1bd0-49d3-adf0-960afe257087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:04.979553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73aeda-1bd0-49d3-adf0-960afe257087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:04.980320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73aeda-1bd0-49d3-adf0-960afe257087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:04.981927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73aeda-1bd0-49d3-adf0-960afe257087 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:04.994815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1327/2637] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:22:05.000153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:05.014421 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b4f7b-ae1a-4898-b914-91085ebbc559 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:05.029047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:05.029047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:05.029316 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:05.029765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] PATH_INFO: `/v3/projects/d1e56d81aa5942c799a86aab601d1d3c/users/ddf41bbc3d6844b8a219b5cc8c46a73d/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:05.053976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e56d81aa5942c799a86aab601d1d3c, user_id=ddf41bbc3d6844b8a219b5cc8c46a73d, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:05.057761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:05.178260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1311/2638] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:04 2022] PUT /identity/v3/projects/d1e56d81aa5942c799a86aab601d1d3c/users/ddf41bbc3d6844b8a219b5cc8c46a73d/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:05.189861 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:05.190182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:05.191234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:05.252038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] MFA Rules not processed for user `ddf41bbc3d6844b8a219b5cc8c46a73d`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:05.252154 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:05.333799 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1328/2639] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:05 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:05.374283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:05.376261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:05.483051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73c67-f306-42e6-bcf0-a03661474d79 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:05.489338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf91b04-7973-4057-b901-43883c008802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:05.490255 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91b04-7973-4057-b901-43883c008802 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:05.490701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91b04-7973-4057-b901-43883c008802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:05.491137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91b04-7973-4057-b901-43883c008802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:05.501535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf91b04-7973-4057-b901-43883c008802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:05.503692 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf91b04-7973-4057-b901-43883c008802 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:05.515727 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1312/2640] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:05 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:05.532220 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:05.550517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:05.619967 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f309d9c-1486-4a06-bed8-134b05a3434a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:05.625425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:05.626626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:05.627021 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:05.627408 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] PATH_INFO: `/v3/users/ddf41bbc3d6844b8a219b5cc8c46a73d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:05.629018 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf41bbc3d6844b8a219b5cc8c46a73d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:05.631148 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:05.876618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf41bbc3d6844b8a219b5cc8c46a73d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:05.898007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf41bbc3d6844b8a219b5cc8c46a73d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:05.899393 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf41bbc3d6844b8a219b5cc8c46a73d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:05.968496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf41bbc3d6844b8a219b5cc8c46a73d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:05.969128 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf41bbc3d6844b8a219b5cc8c46a73d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:05.991434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1329/2641] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:22:05 2022] DELETE /identity/v3/users/ddf41bbc3d6844b8a219b5cc8c46a73d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:05.995280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:05.996137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:05.996300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:06.025526 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:06.026789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:06.085335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:06.103405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1313/2642] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:06.113286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:06.114750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:06.182637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962adc86-a528-4d92-82e1-805aaf1534cd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:06.186386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:06.187047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:06.187334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:06.187668 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:06.200873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:06.202335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:06.213642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1330/2643] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:22:06.689093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:06.689975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:06.706765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8253c92-b72f-44c0-9bd6-19681ed9c366 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:06.711989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:06.713013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:06.713300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:06.713631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] PATH_INFO: `/v3/projects/d1e56d81aa5942c799a86aab601d1d3c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:06.716021 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e56d81aa5942c799a86aab601d1d3c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:06.717965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:06.798618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:06.800844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:06.821556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7be7b-76e3-4571-92c0-9d76faeccdd8 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:06.841661 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e56d81aa5942c799a86aab601d1d3c', 'request_id': 'req-e583df93-b242-4c4b-b712-534866386521'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:06.880488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:06.908363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e56d81aa5942c799a86aab601d1d3c', 'request_id': 'req-e583df93-b242-4c4b-b712-534866386521'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:06.917147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e56d81aa5942c799a86aab601d1d3c', 'request_id': 'req-e583df93-b242-4c4b-b712-534866386521'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:06.931757 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:06.933134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:06.933611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:06.934051 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] PATH_INFO: `/v3/users/0eb87dacc0b9495bbac46448438ea3db` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:06.935726 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb87dacc0b9495bbac46448438ea3db)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:06.938638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:06.947014 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] The token cache is being invalidate because project d1e56d81aa5942c799a86aab601d1d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:22:06.947452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:06.948249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e583df93-b242-4c4b-b712-534866386521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:06.950584 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1314/2644] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:22:06 2022] DELETE /identity/v3/projects/d1e56d81aa5942c799a86aab601d1d3c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:06.955627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe18d-95dc-4e7b-ab36-fdb6c489fb82 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:06.956195 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe18d-95dc-4e7b-ab36-fdb6c489fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:06.956478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe18d-95dc-4e7b-ab36-fdb6c489fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:06.990978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-21ebe18d-95dc-4e7b-ab36-fdb6c489fb82 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:06.992494 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-21ebe18d-95dc-4e7b-ab36-fdb6c489fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.002341 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1315/2645] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:07.010338 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.010895 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.011335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.031766 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:07.032931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.042957 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1316/2646] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:07.047128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.057329 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078547fa-bafa-444f-9262-8fbfad7e436c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.062273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.062934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.063222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.063501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.064259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:22:07.064568 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.066242 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.082265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1317/2647] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 24 10:22:07.083233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.093582 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187db4ee-1357-446b-bbf0-a889398a1f50 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.099114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.099771 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.100089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.100393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.101080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.103002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.149420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb87dacc0b9495bbac46448438ea3db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:07.162422 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb87dacc0b9495bbac46448438ea3db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:07.167771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb87dacc0b9495bbac46448438ea3db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:07.236035 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1318/2648] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:22:07 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:22:07.240531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.257674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb87dacc0b9495bbac46448438ea3db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:07.260646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d3204f51-ddad-465d-9628-7c8c1aaff91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb87dacc0b9495bbac46448438ea3db'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:07.275635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1331/2649] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:22:06 2022] DELETE /identity/v3/users/0eb87dacc0b9495bbac46448438ea3db => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:22:07.280013 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.280303 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.280582 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.298290 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:07.299528 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.307202 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f6fdd-50fc-4ee5-9af3-428111dc614a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.337976 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:07.360381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1332/2650] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:07.368927 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.369740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.370075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.370361 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.370951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.371716 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.372214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.374131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.428556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fee4-2210-4d44-8823-d03f9dd72056 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.432193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.432844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.433130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.433410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.440821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:07.443556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.445864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.458412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1319/2651] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:22:07 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:22:07.458620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1333/2652] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:07.463718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.465485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.477701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2fd75-258a-47a5-8770-27eb6102a234 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.482918 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.483150 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.483436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.483746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.484507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.486117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.497009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1320/2653] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:07.501187 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.512607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca5fed-d188-4ab2-9c1f-c9c6d62243dc service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.517294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ae6b6-7514-41d8-8798-bfc51d80141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.517957 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae6b6-7514-41d8-8798-bfc51d80141c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.518294 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae6b6-7514-41d8-8798-bfc51d80141c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.518638 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ae6b6-7514-41d8-8798-bfc51d80141c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.519741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ae6b6-7514-41d8-8798-bfc51d80141c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.521367 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ae6b6-7514-41d8-8798-bfc51d80141c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.531815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1334/2654] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:07.536109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.554305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad86f1a-1a55-4cd7-b21a-4050f5ca5540 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.560631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.561627 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.562020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.562401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] PATH_INFO: `/v3/projects/f4c9c14cf4bc42878a2f63a0ffa2762e/users/c793637b93de4def9e2dd271c96f26a2/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.578541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c9c14cf4bc42878a2f63a0ffa2762e, user_id=c793637b93de4def9e2dd271c96f26a2, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.581473 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.657418 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1321/2655] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:07 2022] PUT /identity/v3/projects/f4c9c14cf4bc42878a2f63a0ffa2762e/users/c793637b93de4def9e2dd271c96f26a2/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:07.663077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.663483 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.663776 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.685533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:07.685533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.748816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1335/2656] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:07.758400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.760260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.819152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d9f61-0e7f-42a8-821d-3d48a6d3bac3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.822914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907be163-063f-4d5a-b0dd-f5b7d8a09d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.823566 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907be163-063f-4d5a-b0dd-f5b7d8a09d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.823915 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907be163-063f-4d5a-b0dd-f5b7d8a09d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.824194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907be163-063f-4d5a-b0dd-f5b7d8a09d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.833887 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907be163-063f-4d5a-b0dd-f5b7d8a09d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.835577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907be163-063f-4d5a-b0dd-f5b7d8a09d35 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:07.845015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1322/2657] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:07.861522 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:07.863825 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:07.876974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3831b0-7ee2-4029-9fc0-aec226908322 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:07.883006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:07.883973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:07.884266 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:07.884558 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] PATH_INFO: `/v3/projects/2818929861c14c179c65d4ea110697ff` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:07.885771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2818929861c14c179c65d4ea110697ff)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:07.888452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.037216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2818929861c14c179c65d4ea110697ff', 'request_id': 'req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:08.043693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2818929861c14c179c65d4ea110697ff', 'request_id': 'req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:08.049783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2818929861c14c179c65d4ea110697ff', 'request_id': 'req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:08.139331 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] The token cache is being invalidate because project 2818929861c14c179c65d4ea110697ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:22:08.139718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:08.140524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e4bc9a49-c5b6-4ed2-a1d5-136ec4fa3ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:22:08.142258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1336/2658] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:22:07 2022] DELETE /identity/v3/projects/2818929861c14c179c65d4ea110697ff => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:08.147706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.148291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.148291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.167819 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:08.169047 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:08.246867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1323/2659] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:08.254606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.254904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.255210 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.275260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:08.276508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:08.285280 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1337/2660] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:08.289440 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.299208 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fa775-617a-42b8-bace-81979bf8ef8d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.304223 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.304986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.305159 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.305448 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.306171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:22:08.306483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.308203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.320071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1324/2661] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:22:08.324458 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.334512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4e8d4-e1c6-405e-9958-684a34ed6e5d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.339555 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.347248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.347248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.347248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.347248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.347248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.424244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1338/2662] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:22:08 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:08.428305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.439485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443579d-a031-4806-9fa3-637fe738456d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.462703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:08.506763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.507420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.507703 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.508037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.508743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.510664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.591461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1325/2663] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:22:08 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:08.595544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.606159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee4551-4cf4-4c1b-aee4-04d12de74958 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.610753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.611414 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.611699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.612107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.612961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.614531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.628614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1339/2664] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:08.630024 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.640666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df811-de58-4272-878d-c043299ee02b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.646201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcdba4-c2ab-477b-8f5c-0cf9a33c73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.646980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcdba4-c2ab-477b-8f5c-0cf9a33c73dc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.647363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcdba4-c2ab-477b-8f5c-0cf9a33c73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.647738 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcdba4-c2ab-477b-8f5c-0cf9a33c73dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.648618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcdba4-c2ab-477b-8f5c-0cf9a33c73dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.650377 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcdba4-c2ab-477b-8f5c-0cf9a33c73dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.662205 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1326/2665] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:08.665111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.675607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637db9b2-542a-4658-9218-97c82a1203c0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.680181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.681061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.681340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.681612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] PATH_INFO: `/v3/projects/b866575bf960414ba6be2ac0fffe5e11/users/a21f92d1ca604c0f9c93b81ed0904a08/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.697672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b866575bf960414ba6be2ac0fffe5e11, user_id=a21f92d1ca604c0f9c93b81ed0904a08, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.701465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.774020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1340/2666] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:08 2022] PUT /identity/v3/projects/b866575bf960414ba6be2ac0fffe5e11/users/a21f92d1ca604c0f9c93b81ed0904a08/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:08.779146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065497d-492e-430c-a438-d6d33ed54092 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.779438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065497d-492e-430c-a438-d6d33ed54092 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.779718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065497d-492e-430c-a438-d6d33ed54092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.797724 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3065497d-492e-430c-a438-d6d33ed54092 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:08.798935 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3065497d-492e-430c-a438-d6d33ed54092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:08.858694 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1327/2667] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:22:08.868891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:08.870671 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:08.878784 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:08.929538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892bede-db06-4694-b079-6d3d1a72f3d7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:08.933736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:08.934385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:08.934666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:08.934940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:08.944033 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:08.945464 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:08.954822 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1341/2668] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:14.296720 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:14.297265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:14.297265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:14.337267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] MFA Rules not processed for user `c793637b93de4def9e2dd271c96f26a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:14.338527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:14.437881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:14.438412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1328/2669] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:14.439516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:14.453665 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ca0df-70a6-4612-a492-174e767077d8 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:14.464034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:14.466932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:14.466932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:14.466932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:14.466932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:14.468560 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:14.607032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1342/2670] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:22:14 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:14.611180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:14.625871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cb795-d309-400b-b9af-fdcf4d709a1b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:14.659145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:14.704267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:14.705379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:14.705379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:14.705656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:14.707285 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:14.709390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:14.823309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1329/2671] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:22:14 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:22:14.827479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:14.840297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55331-c17b-4e47-9c3d-c1f30ca3844f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:14.846332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:14.856342 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:14.856635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:14.856920 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:14.857672 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:14.861447 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:14.881559 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1343/2672] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:14.889288 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:14.899921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08786-2877-4e9c-b906-b14079445b5f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:14.905422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:14.906893 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:14.907399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:14.907961 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] PATH_INFO: `/v3/projects/1d3e7dc4415d42e788a93f7820b72cb1/users/e77b206dea8447fcb84ac1cd30bebcbe/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:14.928459 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3e7dc4415d42e788a93f7820b72cb1, user_id=e77b206dea8447fcb84ac1cd30bebcbe, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:14.932725 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:15.067503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1330/2673] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:14 2022] PUT /identity/v3/projects/1d3e7dc4415d42e788a93f7820b72cb1/users/e77b206dea8447fcb84ac1cd30bebcbe/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:15.072570 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:15.086289 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297d33c-cc52-498e-9a65-6af8356e3779 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:15.207595 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753beb5-7c53-455e-a996-834f0178f733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:15.208656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753beb5-7c53-455e-a996-834f0178f733 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:15.209162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753beb5-7c53-455e-a996-834f0178f733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:15.210472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753beb5-7c53-455e-a996-834f0178f733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:15.211648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753beb5-7c53-455e-a996-834f0178f733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:15.213571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6753beb5-7c53-455e-a996-834f0178f733 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:15.242701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1344/2674] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:15.247926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:15.266476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f33e54-56fe-4364-89d2-9089b6c9493a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:15.275372 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:15.276415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:15.276706 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:15.277084 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] PATH_INFO: `/v3/projects/1d3e7dc4415d42e788a93f7820b72cb1/users/e77b206dea8447fcb84ac1cd30bebcbe/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:15.279461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3e7dc4415d42e788a93f7820b72cb1, user_id=e77b206dea8447fcb84ac1cd30bebcbe, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:15.282414 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:15.301129 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1331/2675] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:15 2022] PUT /identity/v3/projects/1d3e7dc4415d42e788a93f7820b72cb1/users/e77b206dea8447fcb84ac1cd30bebcbe/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:15.373561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:15.374732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:15.374732 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:15.404374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] MFA Rules not processed for user `a21f92d1ca604c0f9c93b81ed0904a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:15.405610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:15.494752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:15.507214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1345/2676] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:15.510758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:15.594091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1c577-0cba-4b65-85c4-31e946be5c77 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:15.601959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:15.601959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:15.601959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:15.602328 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:15.603577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:15.606128 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:15.760624 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1332/2677] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:22:15 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:22:15.764802 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:15.776891 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65351c7-8629-4645-baec-b991b5d5fc64 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:15.902816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:15.910407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:15.910407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:15.910407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:15.910407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:15.910407 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:16.031309 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:16.032010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1346/2678] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:22:15 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:22:16.067392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c626e-08ae-477d-8db2-1755c1147d04 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:16.072185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:16.072866 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:16.073147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:16.073423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:16.074152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:16.076046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:16.091714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1333/2679] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:16.097178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:16.116348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab227470-ed2c-4788-b409-c4c79e77a0f3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:16.124286 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:16.125506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:16.128028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:16.128028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] PATH_INFO: `/v3/projects/196a016d0c6b40a2850415a2cd55f62a/users/3010e852a07741e4b7bcd79067654ecc/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:16.149256 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196a016d0c6b40a2850415a2cd55f62a, user_id=3010e852a07741e4b7bcd79067654ecc, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:16.152213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:16.246392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1347/2680] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:16 2022] PUT /identity/v3/projects/196a016d0c6b40a2850415a2cd55f62a/users/3010e852a07741e4b7bcd79067654ecc/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:16.250406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:16.264009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a2c9f-07fe-4f8d-ac4a-40e443392f67 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:16.337850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:16.355131 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70543e-c184-4473-b485-615bc858c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:16.355858 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70543e-c184-4473-b485-615bc858c2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:16.356293 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70543e-c184-4473-b485-615bc858c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:16.356579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70543e-c184-4473-b485-615bc858c2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:16.357315 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70543e-c184-4473-b485-615bc858c2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:16.359141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70543e-c184-4473-b485-615bc858c2a0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:16.376481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1334/2681] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:22:16.381064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:16.393924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3c1b3-7370-477f-af75-4e652e3c6752 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:16.399232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:16.400350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:16.400639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:16.400916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] PATH_INFO: `/v3/projects/196a016d0c6b40a2850415a2cd55f62a/users/3010e852a07741e4b7bcd79067654ecc/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:16.403034 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=196a016d0c6b40a2850415a2cd55f62a, user_id=3010e852a07741e4b7bcd79067654ecc, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:16.405889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:16.426569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1348/2682] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:22:16 2022] PUT /identity/v3/projects/196a016d0c6b40a2850415a2cd55f62a/users/3010e852a07741e4b7bcd79067654ecc/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:22:19.933667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef90b8-3858-4f34-a102-cc07bfcb3353 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:19.934565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef90b8-3858-4f34-a102-cc07bfcb3353 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:19.935007 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef90b8-3858-4f34-a102-cc07bfcb3353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:19.958523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-36ef90b8-3858-4f34-a102-cc07bfcb3353 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:19.960046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36ef90b8-3858-4f34-a102-cc07bfcb3353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:20.087167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1335/2683] 10.222.0.44 () {58 vars in 967 bytes} [Tue May 24 10:22:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:20.110259 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:20.112798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:20.332897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcc8ce-85d3-42e8-a0b9-09a52257c393 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:20.344255 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:20.345030 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:20.345320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:20.345615 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:20.370151 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:20.372044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:20.396695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1349/2684] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:22:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:22:23.629546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd481-82bb-45b6-8162-439c42b8ca2c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:23.630049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd481-82bb-45b6-8162-439c42b8ca2c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:23.630137 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd481-82bb-45b6-8162-439c42b8ca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:23.683313 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f95fd481-82bb-45b6-8162-439c42b8ca2c None None] MFA Rules not processed for user `e77b206dea8447fcb84ac1cd30bebcbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:23.686199 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f95fd481-82bb-45b6-8162-439c42b8ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:23.796870 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1336/2685] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:23.812411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:23.814107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:23.876892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:23.897098 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80142c-0cf3-40ea-96ee-e0507b5c858b service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:23.901376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711191915364aa7b4436dfbb9844c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:23.902270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:23.902743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:23.903277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:24.002518 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:24.004366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:24.020437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1350/2686] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:24.353009 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee77fe4-2381-4cb2-949b-ff4553aab337 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:24.353294 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee77fe4-2381-4cb2-949b-ff4553aab337 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:24.353879 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee77fe4-2381-4cb2-949b-ff4553aab337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:24.375100 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8ee77fe4-2381-4cb2-949b-ff4553aab337 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:24.376342 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ee77fe4-2381-4cb2-949b-ff4553aab337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:24.386081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1337/2687] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:24.401565 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:24.414607 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf7ffd-fc7a-4343-960f-4814767b82d7 service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:24.420346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:24.421016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:24.421304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:24.421577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:24.432569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:24.434105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:24.443880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1351/2688] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:22:25.593222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:25.594157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:25.594643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:25.653283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] MFA Rules not processed for user `3010e852a07741e4b7bcd79067654ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:25.655212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:25.754237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:25.769919 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1338/2689] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:25.783156 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:25.786203 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:25.987835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99577fe-5d23-4796-9591-309f350baa2a service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:25.999779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99138f44-11c0-472b-be89-6b78555a302a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:26.000479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99138f44-11c0-472b-be89-6b78555a302a service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:26.000762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99138f44-11c0-472b-be89-6b78555a302a service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:26.001037 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99138f44-11c0-472b-be89-6b78555a302a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:26.121630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99138f44-11c0-472b-be89-6b78555a302a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:26.125648 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99138f44-11c0-472b-be89-6b78555a302a service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:26.139335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1352/2690] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:26.265258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:26.266875 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:26.435272 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aad77-cf72-4eb0-b14a-7e001c65acdc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:26.456353 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:26.459551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:26.459551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:26.459551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:26.465857 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:26.500750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:26.503438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74937a91-42ce-402e-98f5-54ce93e95298 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:26.547513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1339/2691] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:29.750860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:29.751445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:29.751445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:29.770841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] MFA Rules not processed for user `a21f92d1ca604c0f9c93b81ed0904a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:29.772093 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:29.779105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1353/2692] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:36.527667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=34 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.314120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff611-2e62-4783-bfcd-e4bd3cab7118 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:37.315117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff611-2e62-4783-bfcd-e4bd3cab7118 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:37.315483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff611-2e62-4783-bfcd-e4bd3cab7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:37.333115 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-20eff611-2e62-4783-bfcd-e4bd3cab7118 None None] MFA Rules not processed for user `c793637b93de4def9e2dd271c96f26a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:37.334290 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-20eff611-2e62-4783-bfcd-e4bd3cab7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:37.341404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1340/2693] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:22:37.601261 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:37.615064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.657388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9fdf6-b8c1-462d-b512-d50e99fa2cb7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:37.661724 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:37.662376 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:37.662660 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:37.662937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:37.664750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:37.675503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:37.676953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:37.684832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1354/2694] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:22:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:22:42.772267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:42.772778 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:42.772865 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:42.791367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:22:42.792663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:22:42.800419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1341/2695] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:22:42.826691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:22:42.839504 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb918bd-7082-410b-807a-b8d0c05423da service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:22:42.844525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424e84b-4873-4a13-98d1-8f07d9417274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:22:42.845162 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e84b-4873-4a13-98d1-8f07d9417274 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:22:42.845472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e84b-4873-4a13-98d1-8f07d9417274 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:22:42.845750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424e84b-4873-4a13-98d1-8f07d9417274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:22:42.853982 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e84b-4873-4a13-98d1-8f07d9417274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:22:42.855485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424e84b-4873-4a13-98d1-8f07d9417274 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:22:42.863466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1355/2696] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:22:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 24 10:22:52.785433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:52.860248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=26 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:09.299476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:23:09.309351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934bcdf-4d27-4195-be7d-902e50d30ed6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:23:09.312924 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:23:09.313558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:23:09.313848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:23:09.314119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:23:09.323393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:23:09.325573 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:23:09.334182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1342/2697] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:23:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:23:12.612953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:23:12.612953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:23:12.612953 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:23:12.632741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] MFA Rules not processed for user `4985774959804070b1d86f7e47b02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:23:12.634204 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:23:12.666634 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:23:12.675138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3010d0-057b-4947-83c5-c0c6539e6505 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:23:12.679287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:23:12.680059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:23:12.680349 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:23:12.680629 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:23:12.689782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:23:12.691280 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:23:12.692853 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1356/2698] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:23:12.701190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1343/2699] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:23:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 24 10:23:22.685339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=25 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:22.696594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=12 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:17.672475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:17.682593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d9e7a-f43d-4fd9-bc8b-46dd54264207 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:17.686146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:17.686779 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:17.687090 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:17.687368 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:17.689157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:17.702440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:17.703823 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd4912-adf2-45fb-ad42-b14b171a0010 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:17.715048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1357/2700] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:24:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:24:22.577432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:22.586700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858602e-e0c2-4ea6-9fa7-5bc531e9677f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:22.590863 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:22.591492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:22.591775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:22.592077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:22.593780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:22.607540 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:22.608997 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:22.620015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1344/2701] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:24:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:24:26.496833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559bcc1-dcb8-417e-87cf-b8ba0bdd0042 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:26.499359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559bcc1-dcb8-417e-87cf-b8ba0bdd0042 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:26.499359 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559bcc1-dcb8-417e-87cf-b8ba0bdd0042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:26.522270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0559bcc1-dcb8-417e-87cf-b8ba0bdd0042 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:24:26.523741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0559bcc1-dcb8-417e-87cf-b8ba0bdd0042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:26.531503 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1358/2702] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:24:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:24:26.591773 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:26.603462 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e923f-cd0a-4d67-8c8c-6623268a12fa service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:26.609775 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:26.610605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:26.611004 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:26.611389 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:26.621923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:26.623611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:26.633054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1345/2703] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:24:28.813326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:28.814384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:28.814865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:28.837074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:24:28.838601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:28.856211 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1359/2704] 10.222.0.44 () {58 vars in 967 bytes} [Tue May 24 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:24:28.866362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:28.878889 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7efbd-873c-4808-ba61-f84346f4b630 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:28.885369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:28.886837 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:28.887352 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:28.887930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:28.898376 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:28.900986 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:28.910718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1346/2705] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:24:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:24:38.474610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:38.476775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:38.492195 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9a4b8-794d-4c1f-9768-0fe4fc2172d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:38.498590 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:38.501061 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:38.503989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:38.504416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:38.506810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:38.519512 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:38.521646 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:38.531697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1360/2706] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:24:38.907245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=18 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:38.930431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:38.932217 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:38.947318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ebefe-4f14-409a-a112-3564e78ea639 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:38.959434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:38.960144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:38.960551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:38.961093 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:38.962886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:38.976967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:38.978714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:38.992303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1347/2707] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:24:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:24:39.094230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:39.174955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86c0f-634f-4483-bf72-965bf5da71bc service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:39.179780 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:39.180871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:39.181257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:39.181778 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] PATH_INFO: `/v3/users/c793637b93de4def9e2dd271c96f26a2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:39.183212 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c793637b93de4def9e2dd271c96f26a2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:39.185311 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:39.408821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c793637b93de4def9e2dd271c96f26a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:39.420798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c793637b93de4def9e2dd271c96f26a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:39.421468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c793637b93de4def9e2dd271c96f26a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:39.476217 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c793637b93de4def9e2dd271c96f26a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:39.476864 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c793637b93de4def9e2dd271c96f26a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:39.489838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1361/2708] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:24:39 2022] DELETE /identity/v3/users/c793637b93de4def9e2dd271c96f26a2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:24:39.801378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:39.815295 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1520aa-9fa5-4e31-8f35-173d3b0c04b5 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:39.872063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:39.872931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:39.873214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:39.873492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] PATH_INFO: `/v3/projects/f4c9c14cf4bc42878a2f63a0ffa2762e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:39.874768 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c9c14cf4bc42878a2f63a0ffa2762e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:39.876672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:40.000465 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'request_id': 'req-8e650acd-6401-4515-b7af-ef325ff2c3d5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.068628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'request_id': 'req-8e650acd-6401-4515-b7af-ef325ff2c3d5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.075483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'request_id': 'req-8e650acd-6401-4515-b7af-ef325ff2c3d5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.085596 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] The token cache is being invalidate because project f4c9c14cf4bc42878a2f63a0ffa2762e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:24:40.086133 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.086761 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.088420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1348/2709] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:24:39 2022] DELETE /identity/v3/projects/f4c9c14cf4bc42878a2f63a0ffa2762e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:24:40.092674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:40.094066 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:40.107649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b339-c5de-4a60-8e69-e4c7da162482 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:40.145029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:40.162988 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:40.163892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:40.164184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:40.164463 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] PATH_INFO: `/v3/users/e77b206dea8447fcb84ac1cd30bebcbe` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:40.165702 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77b206dea8447fcb84ac1cd30bebcbe)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:40.168190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:40.354062 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77b206dea8447fcb84ac1cd30bebcbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.368230 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77b206dea8447fcb84ac1cd30bebcbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.368947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77b206dea8447fcb84ac1cd30bebcbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.419340 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77b206dea8447fcb84ac1cd30bebcbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.419968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77b206dea8447fcb84ac1cd30bebcbe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.435947 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1362/2710] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:24:40 2022] DELETE /identity/v3/users/e77b206dea8447fcb84ac1cd30bebcbe => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:24:40.678089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:40.679514 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:40.692461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650acd-6401-4515-b7af-ef325ff2c3d5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:40.752923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:40.753793 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:40.754080 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:40.754356 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] PATH_INFO: `/v3/projects/1d3e7dc4415d42e788a93f7820b72cb1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:40.755585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3e7dc4415d42e788a93f7820b72cb1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:40.757550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:40.780020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:40.919370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3e7dc4415d42e788a93f7820b72cb1', 'request_id': 'req-136d9c38-c200-4963-8ccd-051e9a16b342'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.988674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3e7dc4415d42e788a93f7820b72cb1', 'request_id': 'req-136d9c38-c200-4963-8ccd-051e9a16b342'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:40.995305 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3e7dc4415d42e788a93f7820b72cb1', 'request_id': 'req-136d9c38-c200-4963-8ccd-051e9a16b342'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:41.005675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] The token cache is being invalidate because project 1d3e7dc4415d42e788a93f7820b72cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:24:41.006304 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:41.006666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-136d9c38-c200-4963-8ccd-051e9a16b342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:24:41.008325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1349/2711] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:24:40 2022] DELETE /identity/v3/projects/1d3e7dc4415d42e788a93f7820b72cb1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:24:43.884536 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:43.886045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:43.956908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a101a-d236-4d06-b4ca-3d0b32b38600 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:44.009097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:44.016460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:44.017201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:44.017494 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:44.017773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:44.019564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:44.030856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:44.032482 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:44.043159 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1363/2712] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:24:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:24:46.343408 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38fc04-abc3-4f57-9bbd-be9a6f71ad1e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:46.343912 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38fc04-abc3-4f57-9bbd-be9a6f71ad1e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:46.344036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38fc04-abc3-4f57-9bbd-be9a6f71ad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:46.361753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3d38fc04-abc3-4f57-9bbd-be9a6f71ad1e None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:24:46.362970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d38fc04-abc3-4f57-9bbd-be9a6f71ad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:46.416492 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1350/2713] 10.222.0.44 () {58 vars in 1009 bytes} [Tue May 24 10:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:24:46.428385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:24:46.429889 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:24:46.499076 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf603-e049-4b2f-880f-0aac5798a354 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:24:46.504052 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:24:46.504698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:24:46.504983 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:24:46.505260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:24:46.513244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:24:46.514824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:24:46.522742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1364/2714] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:24:56.409883 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:56.519509 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=36 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:02.477321 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fc63-9976-4631-a617-ccb6a3985e45 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:02.477830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fc63-9976-4631-a617-ccb6a3985e45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:02.477941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452fc63-9976-4631-a617-ccb6a3985e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:02.496862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0452fc63-9976-4631-a617-ccb6a3985e45 None None] MFA Rules not processed for user `651012f4a3124dcab018f1e7a11a59bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:02.498061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0452fc63-9976-4631-a617-ccb6a3985e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:02.505467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1351/2715] 10.222.0.44 () {58 vars in 967 bytes} [Tue May 24 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:02.517279 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:02.527541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad679db-8aa0-4022-80ae-03c87651a191 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:02.532598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1bede-0f32-455b-9e3c-bc03886dd301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7af6dbe9ff8421f80acf0405be3088c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:02.533316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bede-0f32-455b-9e3c-bc03886dd301 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:02.533663 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bede-0f32-455b-9e3c-bc03886dd301 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:02.533943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1bede-0f32-455b-9e3c-bc03886dd301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:02.542770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1bede-0f32-455b-9e3c-bc03886dd301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:02.544323 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1bede-0f32-455b-9e3c-bc03886dd301 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:02.553398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1365/2716] 10.222.0.44 () {60 vars in 1384 bytes} [Tue May 24 10:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 24 10:25:12.490595 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:12.549828 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:23.507684 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833401b-ff2a-4809-90d4-145dc934540a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:23.508265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833401b-ff2a-4809-90d4-145dc934540a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:23.508265 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833401b-ff2a-4809-90d4-145dc934540a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:23.509685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1352/2717] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:25:23.515636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a778f5-0982-49c6-b097-c15e75bdbaa2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:23.516137 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a778f5-0982-49c6-b097-c15e75bdbaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:23.516234 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a778f5-0982-49c6-b097-c15e75bdbaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:23.534603 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f4a778f5-0982-49c6-b097-c15e75bdbaa2 None None] MFA Rules not processed for user `dcb8facb574a4935aa7fb390397c1cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:23.535960 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4a778f5-0982-49c6-b097-c15e75bdbaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:23.589547 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1366/2718] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:23.601264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833401b-ff2a-4809-90d4-145dc934540a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:23.602972 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2833401b-ff2a-4809-90d4-145dc934540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:23.616813 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833401b-ff2a-4809-90d4-145dc934540a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:23.620946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cef33-c84d-4225-b95b-72ae790f24c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:23.621822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cef33-c84d-4225-b95b-72ae790f24c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:23.622112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cef33-c84d-4225-b95b-72ae790f24c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:23.622391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cef33-c84d-4225-b95b-72ae790f24c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:23.629410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cef33-c84d-4225-b95b-72ae790f24c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:23.630845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cef33-c84d-4225-b95b-72ae790f24c3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:23.638787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1353/2719] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:23.721031 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9446-58a0-41db-a453-131d058f3978 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:23.721325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9446-58a0-41db-a453-131d058f3978 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:23.721610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9446-58a0-41db-a453-131d058f3978 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:23.722985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1367/2720] 10.222.0.44 () {54 vars in 921 bytes} [Tue May 24 10:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 24 10:25:23.728259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:23.728549 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:23.728826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:23.748216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] MFA Rules not processed for user `6dc6411c631a41d5a22ee51adca2b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:23.749431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:23.815600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1354/2721] 10.222.0.44 () {58 vars in 1018 bytes} [Tue May 24 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:23.826216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc9446-58a0-41db-a453-131d058f3978 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:23.827985 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-82dc9446-58a0-41db-a453-131d058f3978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:23.841650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc9446-58a0-41db-a453-131d058f3978 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:23.845181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:23.845805 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:23.846086 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:23.846360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:23.856977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:23.858399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:23.869074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1368/2722] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:33.805746 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=37 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:33.864405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=29 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:34.253043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:34.254452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:34.310198 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba83bf-7c84-4eca-9a5e-5dfb4bb7a7ba None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:34.313751 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:34.314390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:34.314674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:34.314956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:34.316763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:34.376846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:34.378296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:34.387628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1355/2723] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:36.880317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:36.881844 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:36.897596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabb65f-9358-4c7f-9f1d-51501256022f service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:36.903586 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:36.904260 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:36.904553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:36.904834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:36.906602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:36.919653 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:36.922099 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:36.932015 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1369/2724] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:37.270714 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:37.272182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:37.298464 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e6e6-952c-41eb-932e-54e8c68d12b9 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:37.312876 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:37.318247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:37.318247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:37.318247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:37.318247 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:37.340636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:37.342360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:37.358061 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1356/2725] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:43.095411 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:43.104701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aa1dc-a3aa-42ca-9680-6f4c1561b25c service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:43.108803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:43.109435 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:43.109722 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:43.110004 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:43.111771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:43.174095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:43.175532 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:43.185755 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1370/2726] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:46.703237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:46.707270 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:46.719846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad8ad-d83b-4476-9636-01b94e02320f service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:46.724578 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:46.725550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:46.725832 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:46.726111 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] PATH_INFO: `/v3/users/4985774959804070b1d86f7e47b02473` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:46.727301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4985774959804070b1d86f7e47b02473)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:46.729311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:46.917964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4985774959804070b1d86f7e47b02473'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:46.929579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4985774959804070b1d86f7e47b02473'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:46.930232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4985774959804070b1d86f7e47b02473'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:46.930828 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4985774959804070b1d86f7e47b02473'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:46.989522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c2a45c5c-eb9f-4960-9cef-28a10b78b1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4985774959804070b1d86f7e47b02473'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:47.001747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1357/2727] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:25:46 2022] DELETE /identity/v3/users/4985774959804070b1d86f7e47b02473 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:25:47.260022 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:47.271602 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aed05b-5441-4e5e-a5a9-b5007e1a0595 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:47.329883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:47.330746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.331029 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.331305 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] PATH_INFO: `/v3/projects/f868bceb050645bea79affcb406f94d1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.332492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f868bceb050645bea79affcb406f94d1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:47.334390 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:47.445881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f868bceb050645bea79affcb406f94d1', 'request_id': 'req-d6216409-7341-4416-be58-75d5452cfa23'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:47.452388 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f868bceb050645bea79affcb406f94d1', 'request_id': 'req-d6216409-7341-4416-be58-75d5452cfa23'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:47.457789 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f868bceb050645bea79affcb406f94d1', 'request_id': 'req-d6216409-7341-4416-be58-75d5452cfa23'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:47.541304 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] The token cache is being invalidate because project f868bceb050645bea79affcb406f94d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:25:47.541525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:47.542171 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d6216409-7341-4416-be58-75d5452cfa23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:47.544349 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1371/2728] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:25:47 2022] DELETE /identity/v3/projects/f868bceb050645bea79affcb406f94d1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:25:47.549386 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.549729 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.550011 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.569941 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:47.571134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:47.580419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:47.632215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1358/2729] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:47.641262 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.641576 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.641858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.660950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:47.662348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:47.670297 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1372/2730] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:47.674417 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:47.683882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b78d8c-8d3b-458c-99d2-c2cd40ab1db3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:47.688330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:47.688968 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.689246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.689516 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.690238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:25:47.690527 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:47.692155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:47.704233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1359/2731] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:25:47.708506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:47.714589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:47.719006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6ccec-87d9-4ead-a19a-354fc4ffe435 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:47.723758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:47.724436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.730888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.730888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.730888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:47.730888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:47.814581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1373/2732] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:25:47 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:25:47.818782 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:47.829530 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674520-e73f-420b-80b6-897eb95340fd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:47.885028 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:47.885700 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.885989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.886271 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.887827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:47.889821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:47.955561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1360/2733] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:25:47 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:25:47.959691 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:47.970468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551ab7f-5fb7-4a90-9fc3-86cc1face1a3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:47.975226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:47.975914 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:47.976200 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:47.976477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:47.977229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:47.978815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:47.988788 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1374/2734] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:25:47.992711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:48.003400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf81bb-c80e-4f54-9afa-34056fbb3098 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:48.008005 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea90cce-f8e3-4f05-93fc-c479995a914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:48.008929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea90cce-f8e3-4f05-93fc-c479995a914f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:48.009214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea90cce-f8e3-4f05-93fc-c479995a914f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:48.009493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea90cce-f8e3-4f05-93fc-c479995a914f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:48.010215 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea90cce-f8e3-4f05-93fc-c479995a914f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:48.012532 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea90cce-f8e3-4f05-93fc-c479995a914f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:48.022577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1361/2735] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:25:48.026680 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:48.036709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd0e8-f323-479c-b85f-65bb26735d3c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:48.041480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:48.042347 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:48.042631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:48.042904 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] PATH_INFO: `/v3/projects/2fff760c6e46405b824691dc85ea486f/users/103880a4697f4c5c87a7678200baa3d1/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:48.057285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fff760c6e46405b824691dc85ea486f, user_id=103880a4697f4c5c87a7678200baa3d1, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:48.060549 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:48.138350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1375/2736] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:25:48 2022] PUT /identity/v3/projects/2fff760c6e46405b824691dc85ea486f/users/103880a4697f4c5c87a7678200baa3d1/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:25:48.148399 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:48.148867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:48.149184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:48.175170 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] MFA Rules not processed for user `103880a4697f4c5c87a7678200baa3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:48.176405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:48.237075 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1362/2737] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:48.247618 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:48.249351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:48.306882 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587e421-de0e-4414-ad45-b485aeafc132 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:48.310544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dde5a4-b6de-4cd3-926b-699718cf692b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:48.311184 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dde5a4-b6de-4cd3-926b-699718cf692b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:48.311465 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dde5a4-b6de-4cd3-926b-699718cf692b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:48.311739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dde5a4-b6de-4cd3-926b-699718cf692b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:48.319954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dde5a4-b6de-4cd3-926b-699718cf692b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:48.321366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dde5a4-b6de-4cd3-926b-699718cf692b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:48.330445 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1376/2738] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:58.128639 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:58.138064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:58.190531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89963bae-1cb1-465d-be7e-482c1419d680 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:58.195048 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:58.195939 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:58.196224 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:58.196499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] PATH_INFO: `/v3/users/103880a4697f4c5c87a7678200baa3d1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:58.197672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=103880a4697f4c5c87a7678200baa3d1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:58.199719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:58.326821 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:58.374391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103880a4697f4c5c87a7678200baa3d1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:58.386481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103880a4697f4c5c87a7678200baa3d1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:58.387157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103880a4697f4c5c87a7678200baa3d1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:58.387763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103880a4697f4c5c87a7678200baa3d1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:58.475094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103880a4697f4c5c87a7678200baa3d1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:58.488118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1363/2739] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:25:58 2022] DELETE /identity/v3/users/103880a4697f4c5c87a7678200baa3d1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:25:58.492677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:58.492954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:58.493636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:58.512687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:58.514711 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:58.571685 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1377/2740] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:58.582174 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:58.583551 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:58.639989 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d330db-6e78-42d6-b419-1b8a5134b27f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:58.643486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa4aca-af53-49c2-a2b6-fc902e731bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:58.644145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4aca-af53-49c2-a2b6-fc902e731bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:58.644428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4aca-af53-49c2-a2b6-fc902e731bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:58.644702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa4aca-af53-49c2-a2b6-fc902e731bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:58.653631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa4aca-af53-49c2-a2b6-fc902e731bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:58.658445 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa4aca-af53-49c2-a2b6-fc902e731bc0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:58.664337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1364/2741] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:25:59.035039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.036571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:59.049517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144c4f5-208f-4355-a06a-940a63243622 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.054142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.055005 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.055296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.055579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] PATH_INFO: `/v3/projects/2fff760c6e46405b824691dc85ea486f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.056857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fff760c6e46405b824691dc85ea486f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.058808 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.171078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fff760c6e46405b824691dc85ea486f', 'request_id': 'req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:59.177249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fff760c6e46405b824691dc85ea486f', 'request_id': 'req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:59.183016 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fff760c6e46405b824691dc85ea486f', 'request_id': 'req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:59.250130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] The token cache is being invalidate because project 2fff760c6e46405b824691dc85ea486f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:25:59.250420 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:59.251047 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-307dd6e7-dd21-4d6c-8ee6-a926b0554d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:25:59.252666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1378/2742] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:25:59 2022] DELETE /identity/v3/projects/2fff760c6e46405b824691dc85ea486f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:25:59.257579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.258057 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.258167 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.276995 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:59.279942 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:59.304920 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:59.338059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1365/2743] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:59.345714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.346202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.346385 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.365164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:59.366377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:59.374903 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1379/2744] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:59.379044 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.388975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41194476-4fad-4b61-ab9a-21608cb40ddd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.393433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.394102 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.397862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.397862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.397862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:25:59.397862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.397862 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.408497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1366/2745] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:25:59.412783 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.422923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f51e-f20c-4d90-9f35-cd5aeb57e750 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.427525 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.428202 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.428490 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.428769 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.429462 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.431360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.520440 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1380/2746] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:25:59 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:25:59.524616 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.535831 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980f359-5591-4043-8677-f42d029aa465 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.599626 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.600337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.600614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.600888 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.601581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.603523 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.708398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1367/2747] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:25:59 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:25:59.712727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.723934 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c268ac-66f9-4c4e-9ded-671178114013 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.728442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.729214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.729497 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.729773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.730496 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.732135 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.742545 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1381/2748] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:25:59.746612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.757334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b7273-54d8-4325-b2c5-693bbc350e1c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.762001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dee49-0a72-4d38-97fc-00aa6e6bd90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.762650 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dee49-0a72-4d38-97fc-00aa6e6bd90e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.762938 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dee49-0a72-4d38-97fc-00aa6e6bd90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.763212 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dee49-0a72-4d38-97fc-00aa6e6bd90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.764685 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dee49-0a72-4d38-97fc-00aa6e6bd90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.766314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dee49-0a72-4d38-97fc-00aa6e6bd90e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.776287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1368/2749] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:25:59.780578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:25:59.790530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924321e2-cbbc-4d0c-9bbd-75341ee38876 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:25:59.795257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:25:59.796249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.796533 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.796815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] PATH_INFO: `/v3/projects/1b59a66cf6674b9ca70ea855ad7118c1/users/3babfdadda7d4b33b19da2b7b72617a3/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.811817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b59a66cf6674b9ca70ea855ad7118c1, user_id=3babfdadda7d4b33b19da2b7b72617a3, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:25:59.814492 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:25:59.891334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1382/2750] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:25:59 2022] PUT /identity/v3/projects/1b59a66cf6674b9ca70ea855ad7118c1/users/3babfdadda7d4b33b19da2b7b72617a3/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:25:59.902617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:25:59.902909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:25:59.903189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:25:59.929345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] MFA Rules not processed for user `3babfdadda7d4b33b19da2b7b72617a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:25:59.930534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:25:59.994281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1369/2751] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:25:59.999569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.021270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:00.061794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3a07-86a8-4530-8192-b831f48c4c3f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.066519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.067179 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.067467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.067746 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.068466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.070400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.148617 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1383/2752] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:25:59 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:26:00.152674 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.163438 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2603-9ca0-4a3c-82e3-8b45dc110b30 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.191398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:00.224713 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.225412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.225699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.225979 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.226681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.228656 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.313667 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1370/2753] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:00 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:00.317824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.328258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd5d93-e268-4126-822f-860624c0e4a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.333012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.333679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.333968 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.334248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.335010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.336937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.347900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1384/2754] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:00.353430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.362710 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e4d66-087f-4051-b546-70fab4135d45 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.367454 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.368365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.368645 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.368914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] PATH_INFO: `/v3/projects/ea0271f2bd744cb496bf6f246bb503ec/users/404e3ef9f40f476088a9d1b33f56985f/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.383987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0271f2bd744cb496bf6f246bb503ec, user_id=404e3ef9f40f476088a9d1b33f56985f, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.386607 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.447189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1371/2755] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:00 2022] PUT /identity/v3/projects/ea0271f2bd744cb496bf6f246bb503ec/users/404e3ef9f40f476088a9d1b33f56985f/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:00.452129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.462233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b7e3-678a-4f94-9262-09fde0f9fc93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.518379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2bf0-7180-455a-9475-5698be8784c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.519046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2bf0-7180-455a-9475-5698be8784c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.519329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2bf0-7180-455a-9475-5698be8784c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.519609 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2bf0-7180-455a-9475-5698be8784c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.520358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2bf0-7180-455a-9475-5698be8784c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.521941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2bf0-7180-455a-9475-5698be8784c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.532269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1385/2756] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:00.536534 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.547301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653f9c-1c06-4d7c-8a0e-34fe771d57e5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.555633 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.556594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.556881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.557153 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] PATH_INFO: `/v3/projects/ea0271f2bd744cb496bf6f246bb503ec/users/404e3ef9f40f476088a9d1b33f56985f/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.559120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0271f2bd744cb496bf6f246bb503ec, user_id=404e3ef9f40f476088a9d1b33f56985f, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.562107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.572405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1372/2757] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:00 2022] PUT /identity/v3/projects/ea0271f2bd744cb496bf6f246bb503ec/users/404e3ef9f40f476088a9d1b33f56985f/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:00.582599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.582897 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.583183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.610379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] MFA Rules not processed for user `404e3ef9f40f476088a9d1b33f56985f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:00.611580 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:00.678578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1386/2758] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:00.690207 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:00.699073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:00.749214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5680d-9bdc-457b-a2ee-a70b084b5963 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:00.753017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22050384-9a74-4ca1-ba94-8249fc04b71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:00.753657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22050384-9a74-4ca1-ba94-8249fc04b71e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:00.753943 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22050384-9a74-4ca1-ba94-8249fc04b71e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:00.754222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22050384-9a74-4ca1-ba94-8249fc04b71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:00.763083 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22050384-9a74-4ca1-ba94-8249fc04b71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:00.764646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22050384-9a74-4ca1-ba94-8249fc04b71e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:00.774211 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1373/2759] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:01.592851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:01.611339 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:01.659720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb3f2-ad6f-4862-af19-28e312379e45 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:01.664139 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:01.665039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:01.665324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:01.665598 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] PATH_INFO: `/v3/users/3babfdadda7d4b33b19da2b7b72617a3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:01.666771 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3babfdadda7d4b33b19da2b7b72617a3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:01.668725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:01.897916 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3babfdadda7d4b33b19da2b7b72617a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:01.910009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3babfdadda7d4b33b19da2b7b72617a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:01.910626 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3babfdadda7d4b33b19da2b7b72617a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:01.981337 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3babfdadda7d4b33b19da2b7b72617a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:01.982546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3babfdadda7d4b33b19da2b7b72617a3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:01.994937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1387/2760] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:01 2022] DELETE /identity/v3/users/3babfdadda7d4b33b19da2b7b72617a3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:26:01.999571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:02.000146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:02.000258 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:02.017351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:02.018601 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:02.075380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1374/2761] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:02.084796 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:02.086177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:02.142848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50a22-e697-4332-a139-ee82b6c6c2e7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:02.146352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:02.146990 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:02.147269 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:02.147541 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:02.157249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:02.158655 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:02.167851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1388/2762] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:02.584348 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:02.586189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:02.599119 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ca36c-119e-49de-ac65-c493c175a7b9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:02.604292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:02.605156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:02.605444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:02.606218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] PATH_INFO: `/v3/projects/1b59a66cf6674b9ca70ea855ad7118c1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:02.606926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b59a66cf6674b9ca70ea855ad7118c1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:02.608973 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:02.626405 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:02.753605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b59a66cf6674b9ca70ea855ad7118c1', 'request_id': 'req-8b41c1c0-1b78-4ea6-af4f-df515355a23f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:02.810257 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b59a66cf6674b9ca70ea855ad7118c1', 'request_id': 'req-8b41c1c0-1b78-4ea6-af4f-df515355a23f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:02.817785 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b59a66cf6674b9ca70ea855ad7118c1', 'request_id': 'req-8b41c1c0-1b78-4ea6-af4f-df515355a23f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:02.828691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] The token cache is being invalidate because project 1b59a66cf6674b9ca70ea855ad7118c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:02.828929 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:02.829563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:02.831108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1375/2763] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:02 2022] DELETE /identity/v3/projects/1b59a66cf6674b9ca70ea855ad7118c1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:02.835169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:02.850124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9e58-8d4d-4602-9f9f-d6d96aeda6ca service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:02.878133 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:02.901006 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:02.901872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:02.902196 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:02.902694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] PATH_INFO: `/v3/users/404e3ef9f40f476088a9d1b33f56985f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:02.904348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=404e3ef9f40f476088a9d1b33f56985f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:02.906552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:03.042832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404e3ef9f40f476088a9d1b33f56985f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.055032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404e3ef9f40f476088a9d1b33f56985f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.055688 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404e3ef9f40f476088a9d1b33f56985f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.120472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404e3ef9f40f476088a9d1b33f56985f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.121075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ca0306ca-2e6b-47f6-ba67-ba84608875c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404e3ef9f40f476088a9d1b33f56985f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.134413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1389/2764] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:02 2022] DELETE /identity/v3/users/404e3ef9f40f476088a9d1b33f56985f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:03.543411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:03.544928 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:03.560229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c1c0-1b78-4ea6-af4f-df515355a23f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:03.618216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:03.619109 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:03.619393 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:03.619669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] PATH_INFO: `/v3/projects/ea0271f2bd744cb496bf6f246bb503ec` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:03.620884 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0271f2bd744cb496bf6f246bb503ec)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:03.622826 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:03.722019 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0271f2bd744cb496bf6f246bb503ec', 'request_id': 'req-685482a4-1bb2-4fee-8b04-f9b201583bfe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.788914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0271f2bd744cb496bf6f246bb503ec', 'request_id': 'req-685482a4-1bb2-4fee-8b04-f9b201583bfe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.795276 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0271f2bd744cb496bf6f246bb503ec', 'request_id': 'req-685482a4-1bb2-4fee-8b04-f9b201583bfe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.805682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] The token cache is being invalidate because project ea0271f2bd744cb496bf6f246bb503ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:03.805967 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.806642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-685482a4-1bb2-4fee-8b04-f9b201583bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:03.810456 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1376/2765] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:03 2022] DELETE /identity/v3/projects/ea0271f2bd744cb496bf6f246bb503ec => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:03.813501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:03.813794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:03.814110 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:03.832350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:03.833589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:03.896919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1390/2766] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:03.904585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:03.904874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:03.905151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:03.925287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:03.926531 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:03.934571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1377/2767] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:03.938869 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:03.948583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9857-20b7-4cf1-9407-2962aa1a08da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:03.953649 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:03.954295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:03.954579 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:03.954858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:03.955583 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:26:03.955951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:03.957569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:03.969954 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1391/2768] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:26:03.974071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:03.983182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa896a-f938-416b-a329-298ee2267e1d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:03.988203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:03.988850 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:03.989144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:03.989444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:03.990130 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:03.992063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.082871 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1378/2769] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:03 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:04.089430 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.100119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed16e1-26ed-4eda-9b7f-60bc20d3cddd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.140372 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:04.155354 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.156106 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.157048 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.157353 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.158050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.160032 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.218298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1392/2770] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:04 2022] POST /identity/v3/users => generated 283 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:04.222576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.232660 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abef5f-48b1-44a2-9704-84450f71754a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.237237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.237921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.238203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.238478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.239193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.240820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.242161 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:04.252138 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1379/2771] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:04.267075 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.277178 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f723b-cdfb-45cc-a7cc-d71648ff41f0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.281851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa22a-76db-48cc-82c2-6a81e4575995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.282501 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa22a-76db-48cc-82c2-6a81e4575995 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.282786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa22a-76db-48cc-82c2-6a81e4575995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.283064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa22a-76db-48cc-82c2-6a81e4575995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.283813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aa22a-76db-48cc-82c2-6a81e4575995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.289355 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aa22a-76db-48cc-82c2-6a81e4575995 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.295232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1393/2772] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:26:04.299330 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.309185 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435434e-b22a-43a6-8074-aa703089440a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.315184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.316112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.316392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.316668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] PATH_INFO: `/v3/projects/9b953aa7d2d04023973611596114f580/users/ee330eee3f774eb683c4076933a780df/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.331600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b953aa7d2d04023973611596114f580, user_id=ee330eee3f774eb683c4076933a780df, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.334362 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.405969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1380/2773] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:04 2022] PUT /identity/v3/projects/9b953aa7d2d04023973611596114f580/users/ee330eee3f774eb683c4076933a780df/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:04.419238 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.421288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.421288 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.447899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] MFA Rules not processed for user `ee330eee3f774eb683c4076933a780df`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:04.449951 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:04.514416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1394/2774] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 24 10:26:04.519946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.581490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118db30-a44f-4707-8270-3d194a0205b9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.586193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.587038 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.587323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.587600 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.588354 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.590253 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.676975 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1381/2775] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:04 2022] POST /identity/v3/projects => generated 365 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:04.681100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.692478 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff085e-61de-457a-a8dc-686f256b217c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.748295 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.748980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.749270 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.749556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.750405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.752893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.841143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1395/2776] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:04 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:04.845147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.855496 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fb455-fa71-4d42-ac3f-5b24901f4023 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.860936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.861586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.861869 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.862144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.862933 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.864581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:04.875948 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1382/2777] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:04.880044 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:04.889840 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6154a0-c37d-451c-b450-87d0252a4d01 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:04.894450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:04.895321 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:04.895606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:04.895919 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] PATH_INFO: `/v3/projects/6fa0d6702d044a6bb6029aa5b8400120/users/fdbb7f1d86d3454199ea25edc7f55093/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:04.911240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa0d6702d044a6bb6029aa5b8400120, user_id=fdbb7f1d86d3454199ea25edc7f55093, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:04.913900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:05.033918 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1396/2778] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:04 2022] PUT /identity/v3/projects/6fa0d6702d044a6bb6029aa5b8400120/users/fdbb7f1d86d3454199ea25edc7f55093/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:05.037780 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:05.049042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a4f4-f6b4-441d-a933-4a52fa9dd141 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:05.104636 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80792858-034d-4478-a9b1-b260fcb4f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:05.105220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80792858-034d-4478-a9b1-b260fcb4f65d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:05.105502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80792858-034d-4478-a9b1-b260fcb4f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:05.105777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80792858-034d-4478-a9b1-b260fcb4f65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:05.106488 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80792858-034d-4478-a9b1-b260fcb4f65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:05.108105 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80792858-034d-4478-a9b1-b260fcb4f65d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:05.118289 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1383/2779] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:05.122413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:05.132656 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb12670-e8a2-41f6-80ce-4772e83e803f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:05.137239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:05.138111 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:05.138399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:05.138681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] PATH_INFO: `/v3/projects/6fa0d6702d044a6bb6029aa5b8400120/users/fdbb7f1d86d3454199ea25edc7f55093/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:05.140908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa0d6702d044a6bb6029aa5b8400120, user_id=fdbb7f1d86d3454199ea25edc7f55093, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:05.143571 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:05.153713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1397/2780] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:05 2022] PUT /identity/v3/projects/6fa0d6702d044a6bb6029aa5b8400120/users/fdbb7f1d86d3454199ea25edc7f55093/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:05.164571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:05.164864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:05.165147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:05.190830 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] MFA Rules not processed for user `fdbb7f1d86d3454199ea25edc7f55093`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:05.192046 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:05.220921 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:05.257886 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1384/2781] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:05.269562 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:05.271244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:05.277742 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:05.327753 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33d5d2-cf01-4ace-a196-ddee8ca13641 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:05.332529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:05.334381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:05.334725 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:05.335035 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:05.345637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:05.347100 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:05.356761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1398/2782] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:05.721411 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:05.731368 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfa5a9-d94d-4366-a3eb-fde5ef353334 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:05.735664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48038c56-2e01-4b29-b51b-74e8acafe97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:05.736298 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48038c56-2e01-4b29-b51b-74e8acafe97f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:05.736630 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48038c56-2e01-4b29-b51b-74e8acafe97f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:05.736926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48038c56-2e01-4b29-b51b-74e8acafe97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:05.792960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48038c56-2e01-4b29-b51b-74e8acafe97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:05.794398 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48038c56-2e01-4b29-b51b-74e8acafe97f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:05.804018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1385/2783] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:15.364733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=24 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:15.800051 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=43 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:16.378364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:16.483608 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1291b9-76b2-4155-9548-1f4daa1cafb6 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:16.489391 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:16.490258 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:16.490539 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:16.490813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] PATH_INFO: `/v3/users/ee330eee3f774eb683c4076933a780df` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:16.492038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee330eee3f774eb683c4076933a780df)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:16.494012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:16.681697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee330eee3f774eb683c4076933a780df'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:16.693974 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee330eee3f774eb683c4076933a780df'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:16.694666 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee330eee3f774eb683c4076933a780df'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:16.759977 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee330eee3f774eb683c4076933a780df'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:16.760627 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee330eee3f774eb683c4076933a780df'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:16.773803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1399/2784] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:16 2022] DELETE /identity/v3/users/ee330eee3f774eb683c4076933a780df => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:16.778563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:16.778885 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:16.779168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:16.826507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:16.827705 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:16.885676 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1386/2785] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:16.895892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:16.897352 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:16.939201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:16.990543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d37f-fe7d-492f-bb6d-4eae18404960 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:16.994249 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:16.995147 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:16.995451 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:16.996096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:17.005749 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:17.008611 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:17.017480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1400/2786] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:17.417410 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:17.418990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:17.433864 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e05f7-a6ae-4242-8c1c-f7b4b2008538 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:17.439882 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:17.440956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:17.441267 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:17.441675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] PATH_INFO: `/v3/projects/9b953aa7d2d04023973611596114f580` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:17.442913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b953aa7d2d04023973611596114f580)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:17.444891 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:17.542960 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b953aa7d2d04023973611596114f580', 'request_id': 'req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.604562 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b953aa7d2d04023973611596114f580', 'request_id': 'req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.611246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b953aa7d2d04023973611596114f580', 'request_id': 'req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.621618 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] The token cache is being invalidate because project 9b953aa7d2d04023973611596114f580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:17.621906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.622546 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.624136 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1387/2787] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:17 2022] DELETE /identity/v3/projects/9b953aa7d2d04023973611596114f580 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:17.628662 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:17.638739 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b7755-68cc-4c9c-b792-6a57f3a86462 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:17.694690 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:17.695899 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:17.696190 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:17.696468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] PATH_INFO: `/v3/users/fdbb7f1d86d3454199ea25edc7f55093` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:17.697674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbb7f1d86d3454199ea25edc7f55093)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:17.699606 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:17.888473 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbb7f1d86d3454199ea25edc7f55093'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.901011 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbb7f1d86d3454199ea25edc7f55093'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.901682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbb7f1d86d3454199ea25edc7f55093'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.960085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbb7f1d86d3454199ea25edc7f55093'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.960695 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c3e2a475-ee1e-4b96-9956-4c6e5e75aa9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbb7f1d86d3454199ea25edc7f55093'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:17.973477 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1401/2788] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:17 2022] DELETE /identity/v3/users/fdbb7f1d86d3454199ea25edc7f55093 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:18.350878 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:18.352432 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:18.369132 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0ece7-6e58-4c09-9d38-f401c9d91ad2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:18.421461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:18.428317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:18.429190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:18.429537 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:18.429822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] PATH_INFO: `/v3/projects/6fa0d6702d044a6bb6029aa5b8400120` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:18.431062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa0d6702d044a6bb6029aa5b8400120)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:18.433120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:18.538135 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa0d6702d044a6bb6029aa5b8400120', 'request_id': 'req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:18.588533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa0d6702d044a6bb6029aa5b8400120', 'request_id': 'req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:18.594971 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa0d6702d044a6bb6029aa5b8400120', 'request_id': 'req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:18.606068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] The token cache is being invalidate because project 6fa0d6702d044a6bb6029aa5b8400120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:18.606369 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:18.607095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bebc4a9-a767-4aff-9cfb-a520f1318d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:18.608664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1388/2789] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:18 2022] DELETE /identity/v3/projects/6fa0d6702d044a6bb6029aa5b8400120 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:18.614336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:18.614636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:18.614921 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:18.646055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:18.662743 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:18.664345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:18.723599 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1402/2790] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:18.732371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:18.733403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:18.733403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:18.753171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:18.754365 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:18.762202 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1389/2791] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:18.766452 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:18.776530 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83711d62-0eb1-4b21-8723-51fae6893cfa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:18.781091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:18.781750 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:18.782039 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:18.782317 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:18.783306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:26:18.783614 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:18.785246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:18.796775 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1403/2792] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:26:18.801479 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:18.810672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da017a5d-ca82-4353-8184-34f2fc4d74c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:18.815350 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:18.816015 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:18.816300 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:18.816576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:18.817273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:18.819152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:18.916493 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1390/2793] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:18.920612 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:18.930486 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f5731-7370-4d15-b56a-90f9d7fbbd67 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:18.987873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:18.988474 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:18.988761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:18.989038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:18.989773 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:18.991888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:19.064045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1404/2794] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:18 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:19.068332 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:19.078487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a068a0-734c-4255-9028-1d4d012fdb6c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:19.083708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:19.084390 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:19.084668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:19.084940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:19.085652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:19.087539 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:19.098431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1391/2795] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:19.102384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:19.112429 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fefcdf-9466-4726-8c27-5f9e3741c41b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:19.117040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37056be8-1a2a-4948-a93d-677443911fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:19.117713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37056be8-1a2a-4948-a93d-677443911fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:19.117992 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37056be8-1a2a-4948-a93d-677443911fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:19.118268 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37056be8-1a2a-4948-a93d-677443911fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:19.118984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37056be8-1a2a-4948-a93d-677443911fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:19.120593 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37056be8-1a2a-4948-a93d-677443911fb4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:19.131043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1405/2796] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:19.135043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:19.145306 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5531eee-b522-497c-a2d8-0678dc4fc17e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:19.149923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:19.150788 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:19.151065 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:19.151334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] PATH_INFO: `/v3/projects/abe75e4f81f441c6ac8850312a089d94/users/c3f0e83c6c934a8c9ed9ac68a8038ae9/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:19.165504 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe75e4f81f441c6ac8850312a089d94, user_id=c3f0e83c6c934a8c9ed9ac68a8038ae9, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:19.168154 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:19.244380 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1392/2797] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:19 2022] PUT /identity/v3/projects/abe75e4f81f441c6ac8850312a089d94/users/c3f0e83c6c934a8c9ed9ac68a8038ae9/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:26:19.249413 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fae06f-ba30-4fd6-b241-9b14ed82d601 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:19.249706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fae06f-ba30-4fd6-b241-9b14ed82d601 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:19.249987 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fae06f-ba30-4fd6-b241-9b14ed82d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:19.268569 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d9fae06f-ba30-4fd6-b241-9b14ed82d601 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:19.271174 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d9fae06f-ba30-4fd6-b241-9b14ed82d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:19.328377 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1406/2798] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:19.338787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:19.340621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:19.397480 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7a41-2cd7-4856-98f8-3fe5ab86dddb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:19.401229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:19.401873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:19.402156 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:19.402433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:19.411528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:19.413001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:19.422277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1393/2799] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:20.829040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:20.829707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:20.829707 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:20.842416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:20.858049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] MFA Rules not processed for user `c3f0e83c6c934a8c9ed9ac68a8038ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:20.859250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:20.925308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1407/2800] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:20.929791 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:20.939423 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b0537-bb1a-47b4-ad28-c9aaf168e581 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:20.943978 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:20.944657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:20.944940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:20.945216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:20.945909 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:20.947823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:21.024799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1394/2801] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:20 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:21.028867 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:21.040506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3bde-d25e-4014-927a-d466552fc355 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:21.097748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:21.098421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:21.098706 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:21.098986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:21.099676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:21.101619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:21.170246 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1408/2802] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:21 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:26:21.174190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:21.180903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:21.184634 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b411eb-1306-4fd8-846d-72dc3568025c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:21.189413 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:21.190116 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:21.190396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:21.190666 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:21.191379 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:21.193006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:21.203485 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1395/2803] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:26:21.208278 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:21.218409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55980-34cb-400f-b498-b425bbfb4b56 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:21.223912 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:21.224786 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:21.225072 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:21.225350 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] PATH_INFO: `/v3/projects/a587570fd54d4cc7a77e74c016402e7b/users/6e39483fc97f448db36851b37f4e46c0/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:21.240240 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a587570fd54d4cc7a77e74c016402e7b, user_id=6e39483fc97f448db36851b37f4e46c0, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:21.242871 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:21.324616 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1409/2804] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:21 2022] PUT /identity/v3/projects/a587570fd54d4cc7a77e74c016402e7b/users/6e39483fc97f448db36851b37f4e46c0/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:21.328672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:21.339296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3ed7-1b4d-4a3c-abee-1c1ed2ed3079 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:21.397475 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bcc6c-d633-4592-a70b-a63e3b9eb26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:21.398155 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bcc6c-d633-4592-a70b-a63e3b9eb26c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:21.398422 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bcc6c-d633-4592-a70b-a63e3b9eb26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:21.398698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bcc6c-d633-4592-a70b-a63e3b9eb26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:21.399415 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bcc6c-d633-4592-a70b-a63e3b9eb26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:21.401052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bcc6c-d633-4592-a70b-a63e3b9eb26c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:21.410711 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1396/2805] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:21.414993 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:21.425540 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f51797-44ab-46e6-b481-9abde4c05703 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:21.430176 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:21.431069 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:21.431358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:21.431637 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] PATH_INFO: `/v3/projects/a587570fd54d4cc7a77e74c016402e7b/users/6e39483fc97f448db36851b37f4e46c0/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:21.433678 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a587570fd54d4cc7a77e74c016402e7b, user_id=6e39483fc97f448db36851b37f4e46c0, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:21.436363 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:21.448693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1410/2806] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:21 2022] PUT /identity/v3/projects/a587570fd54d4cc7a77e74c016402e7b/users/6e39483fc97f448db36851b37f4e46c0/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:22.555233 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:22.555718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:22.556043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:22.583606 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] MFA Rules not processed for user `6e39483fc97f448db36851b37f4e46c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:22.591225 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:22.656173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1397/2807] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:22.668439 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:22.670193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:22.724610 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:22.728441 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d812d-d86a-44c6-b59d-f3d75372784e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:22.732010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:22.732677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:22.733883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:22.733883 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:22.788619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:22.790074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:22.799374 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1411/2808] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:24.478513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:24.479923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:24.492420 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caef3ce-f5bc-4448-a809-ca97f8c21dc9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:24.496027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:24.496665 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:24.496950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:24.497229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:24.506789 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:24.508273 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:24.517500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1398/2809] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:32.800511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=26 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:34.513382 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=72 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:40.107132 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:40.169748 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cce1dd-3c6f-4164-affd-8a6dcd4e1d5b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:40.174271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:40.175146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:40.175456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:40.175718 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] PATH_INFO: `/v3/users/c3f0e83c6c934a8c9ed9ac68a8038ae9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:40.176938 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f0e83c6c934a8c9ed9ac68a8038ae9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:40.179027 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:40.345025 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f0e83c6c934a8c9ed9ac68a8038ae9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.356943 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f0e83c6c934a8c9ed9ac68a8038ae9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.357552 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f0e83c6c934a8c9ed9ac68a8038ae9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.446485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f0e83c6c934a8c9ed9ac68a8038ae9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.447244 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f0e83c6c934a8c9ed9ac68a8038ae9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.460130 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1412/2810] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:40 2022] DELETE /identity/v3/users/c3f0e83c6c934a8c9ed9ac68a8038ae9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:40.736594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:40.750220 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e5ac0-de5d-4b04-abb3-4a9f142ffacf service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:40.809086 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:40.809949 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:40.810232 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:40.810508 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] PATH_INFO: `/v3/projects/abe75e4f81f441c6ac8850312a089d94` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:40.811668 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe75e4f81f441c6ac8850312a089d94)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:40.813620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:40.912073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe75e4f81f441c6ac8850312a089d94', 'request_id': 'req-724575c5-974c-4f48-b13a-745e2dc927b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.982471 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe75e4f81f441c6ac8850312a089d94', 'request_id': 'req-724575c5-974c-4f48-b13a-745e2dc927b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.988873 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe75e4f81f441c6ac8850312a089d94', 'request_id': 'req-724575c5-974c-4f48-b13a-745e2dc927b3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:40.999345 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] The token cache is being invalidate because project abe75e4f81f441c6ac8850312a089d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:40.999632 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.000291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.001821 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1399/2811] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:40 2022] DELETE /identity/v3/projects/abe75e4f81f441c6ac8850312a089d94 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:41.005940 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:41.007858 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:41.020768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674979ca-2a09-4134-bac0-c56b476fb43a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:41.075879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:41.076751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:41.077038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:41.077318 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] PATH_INFO: `/v3/users/6e39483fc97f448db36851b37f4e46c0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:41.078495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e39483fc97f448db36851b37f4e46c0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:41.080479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:41.102581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:41.271566 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e39483fc97f448db36851b37f4e46c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.283751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e39483fc97f448db36851b37f4e46c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.286502 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e39483fc97f448db36851b37f4e46c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.336594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e39483fc97f448db36851b37f4e46c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.337479 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79af97e8-decf-451d-8779-3cacdd3f53db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e39483fc97f448db36851b37f4e46c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.349948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1413/2812] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:41 2022] DELETE /identity/v3/users/6e39483fc97f448db36851b37f4e46c0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:41.617164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:41.618699 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:41.631096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724575c5-974c-4f48-b13a-745e2dc927b3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:41.688190 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:41.689052 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:41.689335 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:41.689612 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] PATH_INFO: `/v3/projects/a587570fd54d4cc7a77e74c016402e7b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:41.690798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a587570fd54d4cc7a77e74c016402e7b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:41.692770 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:41.780898 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:41.793146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a587570fd54d4cc7a77e74c016402e7b', 'request_id': 'req-e2cc8112-654d-4776-bf0c-d21eba3a4b30'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.912509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a587570fd54d4cc7a77e74c016402e7b', 'request_id': 'req-e2cc8112-654d-4776-bf0c-d21eba3a4b30'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.919827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a587570fd54d4cc7a77e74c016402e7b', 'request_id': 'req-e2cc8112-654d-4776-bf0c-d21eba3a4b30'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.930292 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] The token cache is being invalidate because project a587570fd54d4cc7a77e74c016402e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:41.930583 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.931222 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e2cc8112-654d-4776-bf0c-d21eba3a4b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:41.932787 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1400/2813] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:41 2022] DELETE /identity/v3/projects/a587570fd54d4cc7a77e74c016402e7b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:41.937848 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:41.938138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:41.938416 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:41.956332 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:41.957519 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:42.016597 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1414/2814] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:42.024901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.025194 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.025499 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.044907 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:42.046144 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:42.054444 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1401/2815] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:42.058601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.067975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222a7c6-ac5a-4617-b4c6-94b3109a5243 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.072652 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.073296 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.073581 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.073856 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.074575 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:26:42.074881 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.076527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.088971 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1415/2816] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:26:42.093059 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.102653 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cedfd9-7098-4337-b6da-be6ab5a530bd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.107230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.107923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.108206 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.108478 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.109163 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.111054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.184037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1402/2817] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:42 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:26:42.188057 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.197972 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f75c0-e27f-437c-9b44-2764be51127b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.258437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.259116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.259401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.259677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.260415 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.262328 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.337894 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1416/2818] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:42 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:42.342002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.352401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544b385-972e-4123-a235-eb0727ce9283 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.356966 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.357613 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.357906 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.358168 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.358880 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.360509 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.370628 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1403/2819] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:42.374524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.385199 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cec0a-9397-4c38-bdaf-6979c7debb57 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.389812 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989a58-85d1-4d0a-945b-462636fe5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.390456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989a58-85d1-4d0a-945b-462636fe5be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.390738 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989a58-85d1-4d0a-945b-462636fe5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.391008 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989a58-85d1-4d0a-945b-462636fe5be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.391727 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989a58-85d1-4d0a-945b-462636fe5be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.393453 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989a58-85d1-4d0a-945b-462636fe5be4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.403687 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1417/2820] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:26:42.407579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.417406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11503d04-70f7-4501-bc78-2c284f925a6b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.421969 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.422833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.423114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.423388 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] PATH_INFO: `/v3/projects/d1d62bc1f57249cb8d39ab9acc7f78e3/users/e2db31ffbdf8460cb025be15210cd94a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.438416 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d62bc1f57249cb8d39ab9acc7f78e3, user_id=e2db31ffbdf8460cb025be15210cd94a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.441054 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.508737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1404/2821] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:42 2022] PUT /identity/v3/projects/d1d62bc1f57249cb8d39ab9acc7f78e3/users/e2db31ffbdf8460cb025be15210cd94a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:42.518794 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.519084 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.519364 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.526389 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:42.545963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] MFA Rules not processed for user `e2db31ffbdf8460cb025be15210cd94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:42.547382 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:42.611774 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1418/2822] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:42.623712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.625403 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:42.681145 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511ddaf-0729-45dd-95c6-028fb7193e2a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.684820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daa0fe-50b1-4bc9-aaf7-9f84d1075cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.685483 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa0fe-50b1-4bc9-aaf7-9f84d1075cac service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.690723 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa0fe-50b1-4bc9-aaf7-9f84d1075cac service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.690723 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daa0fe-50b1-4bc9-aaf7-9f84d1075cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.694325 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daa0fe-50b1-4bc9-aaf7-9f84d1075cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.695750 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87daa0fe-50b1-4bc9-aaf7-9f84d1075cac service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.704489 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1405/2823] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:42.724460 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:42.785134 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5548b60-a4c2-421d-95a5-9f9093a041d8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:42.790257 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:42.791121 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:42.791402 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:42.791676 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] PATH_INFO: `/v3/users/e2db31ffbdf8460cb025be15210cd94a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:42.792892 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2db31ffbdf8460cb025be15210cd94a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:42.794800 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:42.943693 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2db31ffbdf8460cb025be15210cd94a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:42.955399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2db31ffbdf8460cb025be15210cd94a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:42.956112 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2db31ffbdf8460cb025be15210cd94a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.032165 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2db31ffbdf8460cb025be15210cd94a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.032793 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2db31ffbdf8460cb025be15210cd94a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.045520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1419/2824] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:42 2022] DELETE /identity/v3/users/e2db31ffbdf8460cb025be15210cd94a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:43.049982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:43.050470 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:43.050593 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:43.068002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:43.069748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:43.119134 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:43.127318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1406/2825] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:43.137860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:43.139284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:43.154544 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:43.197308 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1306-d108-4be8-b678-7a0fead7b978 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:43.200834 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7afd45-54a6-4dd3-ba76-4504c1520405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:43.201481 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7afd45-54a6-4dd3-ba76-4504c1520405 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:43.201766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7afd45-54a6-4dd3-ba76-4504c1520405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:43.202045 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7afd45-54a6-4dd3-ba76-4504c1520405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:43.211472 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7afd45-54a6-4dd3-ba76-4504c1520405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:43.214079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7afd45-54a6-4dd3-ba76-4504c1520405 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:43.222619 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1420/2826] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:43.629652 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:43.631089 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:43.644991 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0a3b-d724-45ab-abed-a2306f64d6aa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:43.650426 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:43.651319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:43.651605 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:43.651913 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] PATH_INFO: `/v3/projects/d1d62bc1f57249cb8d39ab9acc7f78e3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:43.653146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d62bc1f57249cb8d39ab9acc7f78e3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:43.655062 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:43.784032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d62bc1f57249cb8d39ab9acc7f78e3', 'request_id': 'req-d9569ef8-85a6-492a-a6a7-cf401b4a9165'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.868457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d62bc1f57249cb8d39ab9acc7f78e3', 'request_id': 'req-d9569ef8-85a6-492a-a6a7-cf401b4a9165'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.875001 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d62bc1f57249cb8d39ab9acc7f78e3', 'request_id': 'req-d9569ef8-85a6-492a-a6a7-cf401b4a9165'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.885936 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] The token cache is being invalidate because project d1d62bc1f57249cb8d39ab9acc7f78e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:43.886203 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.886846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d9569ef8-85a6-492a-a6a7-cf401b4a9165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:43.888428 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1407/2827] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:43 2022] DELETE /identity/v3/projects/d1d62bc1f57249cb8d39ab9acc7f78e3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:43.893480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:43.893986 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:43.894092 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:43.912264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:43.913485 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:43.971182 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1421/2828] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:43.979959 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:43.980250 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:43.980524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:43.998511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:44.000043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:44.008319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1408/2829] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:44.012450 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.021936 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6122d-c4a2-46fd-a088-d8bfdc15cfdb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.026714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.027360 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.027643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.027955 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.028674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:26:44.028978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.030561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.042412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1422/2830] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:26:44.046459 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.055820 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c0b17-ea49-49a4-83cd-2174782841cc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.060451 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.061091 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.061374 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.061649 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.062318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.064251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.156043 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1409/2831] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:44 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:44.160454 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.171079 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4bae1-f9f1-4cbd-ac49-7e44306540d6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.226698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.227358 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.227642 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.227950 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.228644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.230543 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.307235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1423/2832] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:44 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 24 10:26:44.311251 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.321486 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ba0ca-d4b3-4fe8-b099-3073a05f4a36 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.326031 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.326677 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.326962 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.327237 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.327990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.329581 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.340669 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1410/2833] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:44.344763 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.355285 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790221-0e47-433c-904a-888887bdb269 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.359902 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164cd63-e6fb-47c8-9ede-c56de066ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.360553 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164cd63-e6fb-47c8-9ede-c56de066ba5d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.360838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164cd63-e6fb-47c8-9ede-c56de066ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.361116 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164cd63-e6fb-47c8-9ede-c56de066ba5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.361832 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164cd63-e6fb-47c8-9ede-c56de066ba5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.363409 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164cd63-e6fb-47c8-9ede-c56de066ba5d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.373216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1424/2834] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:44.377210 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.387162 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fa9b7-f794-4cd0-a022-3e16c532050c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.391719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.392619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.392900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.393173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] PATH_INFO: `/v3/projects/f400e3636a08432d95319a3946187b79/users/f2f5428fb3324db39e73096c65b7ab5a/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.408143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f400e3636a08432d95319a3946187b79, user_id=f2f5428fb3324db39e73096c65b7ab5a, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.410800 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.480027 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1411/2835] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:44 2022] PUT /identity/v3/projects/f400e3636a08432d95319a3946187b79/users/f2f5428fb3324db39e73096c65b7ab5a/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:44.490146 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.490438 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.490717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.516896 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] MFA Rules not processed for user `f2f5428fb3324db39e73096c65b7ab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:44.518221 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:44.527851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:44.582386 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1425/2836] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:44.587841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.649355 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4c21e-dd8a-4550-bfea-5454026430dd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.654391 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.655055 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.655407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.655690 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.656412 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.658334 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.766970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1412/2837] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:44 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:44.770299 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.781527 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2219-6253-4003-a0c1-1ab2fc572bdf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.838585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.838965 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.839351 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.839546 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.840277 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.842208 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.949108 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1426/2838] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:44 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:44.952950 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.959467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:44.963535 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069febd-8fc5-4c78-a227-bfc4eece9dca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:44.968107 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:44.968758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:44.969077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:44.969360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:44.970073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:44.971695 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:44.981931 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1413/2839] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:44.992094 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:44.996620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194022-81d5-426e-81fa-a276439c130b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:45.001264 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:45.002142 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:45.002427 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:45.002733 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] PATH_INFO: `/v3/projects/5efd2933d8e3438b8007bdb0fb2b7029/users/7b74548eae634d76a23e3cc7c2009ca3/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:45.019250 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efd2933d8e3438b8007bdb0fb2b7029, user_id=7b74548eae634d76a23e3cc7c2009ca3, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:45.021978 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:45.102873 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1427/2840] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:44 2022] PUT /identity/v3/projects/5efd2933d8e3438b8007bdb0fb2b7029/users/7b74548eae634d76a23e3cc7c2009ca3/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:45.106848 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:45.117151 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fab9a-68d1-41c1-91c2-b0f816a4ad69 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:45.174311 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a036ac8-d300-40ea-9f71-73b37abfa815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:45.174982 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036ac8-d300-40ea-9f71-73b37abfa815 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:45.175274 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036ac8-d300-40ea-9f71-73b37abfa815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:45.175552 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a036ac8-d300-40ea-9f71-73b37abfa815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:45.176319 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a036ac8-d300-40ea-9f71-73b37abfa815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:45.177923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a036ac8-d300-40ea-9f71-73b37abfa815 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:45.187925 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1414/2841] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 24 10:26:45.192009 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:45.202745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107de328-95c0-4f0c-b5a4-92bfaec915fc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:45.207329 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:45.208239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:45.208531 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:45.208806 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] PATH_INFO: `/v3/projects/5efd2933d8e3438b8007bdb0fb2b7029/users/7b74548eae634d76a23e3cc7c2009ca3/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:45.210762 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efd2933d8e3438b8007bdb0fb2b7029, user_id=7b74548eae634d76a23e3cc7c2009ca3, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:45.213714 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:45.224499 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1428/2842] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:45 2022] PUT /identity/v3/projects/5efd2933d8e3438b8007bdb0fb2b7029/users/7b74548eae634d76a23e3cc7c2009ca3/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:45.234611 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:45.234897 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:45.235171 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:45.260994 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] MFA Rules not processed for user `7b74548eae634d76a23e3cc7c2009ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:45.262177 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:45.328892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1415/2843] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:45.340348 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:45.342040 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:45.400254 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad05f8-44e4-4fcb-86f7-1d47245f165c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:45.403758 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7882ac0-1996-4877-be06-496d908d3fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:45.404437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7882ac0-1996-4877-be06-496d908d3fab service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:45.404720 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7882ac0-1996-4877-be06-496d908d3fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:45.404997 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7882ac0-1996-4877-be06-496d908d3fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:45.421383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:45.461284 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7882ac0-1996-4877-be06-496d908d3fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:45.463601 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7882ac0-1996-4877-be06-496d908d3fab service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:45.472613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1429/2844] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:48.341507 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:48.403528 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13aaa0-f928-4485-83ad-30d1f9ec8da0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:48.408063 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:48.408934 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:48.409216 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:48.409490 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] PATH_INFO: `/v3/users/f2f5428fb3324db39e73096c65b7ab5a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:48.410675 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f5428fb3324db39e73096c65b7ab5a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:48.412637 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:48.428068 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:48.600744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f5428fb3324db39e73096c65b7ab5a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:48.612392 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f5428fb3324db39e73096c65b7ab5a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:48.613073 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f5428fb3324db39e73096c65b7ab5a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:48.613673 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f5428fb3324db39e73096c65b7ab5a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:48.695515 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f5428fb3324db39e73096c65b7ab5a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:48.709118 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1416/2845] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:48 2022] DELETE /identity/v3/users/f2f5428fb3324db39e73096c65b7ab5a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:48.713855 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:48.714365 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:48.714489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:48.731226 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:48.732498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:48.791699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1430/2846] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:48.801173 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:48.802580 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:48.860617 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5bb7-6ae7-42d3-8a5e-d44db395fc38 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:48.864120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:48.864760 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:48.865041 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:48.865317 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:48.874529 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:48.875990 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:48.885892 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1417/2847] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:49.270180 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:49.271594 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:49.284556 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dba5e-f1eb-4e34-86bf-e6ed1c88a3a8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:49.290143 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:49.291235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:49.291816 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:49.292216 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] PATH_INFO: `/v3/projects/f400e3636a08432d95319a3946187b79` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:49.293442 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f400e3636a08432d95319a3946187b79)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:49.295426 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:49.410096 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f400e3636a08432d95319a3946187b79', 'request_id': 'req-4602c023-435f-4751-a75c-89537bc9be3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.416872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f400e3636a08432d95319a3946187b79', 'request_id': 'req-4602c023-435f-4751-a75c-89537bc9be3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.422417 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f400e3636a08432d95319a3946187b79', 'request_id': 'req-4602c023-435f-4751-a75c-89537bc9be3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.495456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] The token cache is being invalidate because project f400e3636a08432d95319a3946187b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:49.495745 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.496394 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.497932 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1431/2848] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:49 2022] DELETE /identity/v3/projects/f400e3636a08432d95319a3946187b79 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:49.502184 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:49.512836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b44f-6de8-4093-b8d5-3535236b0dfb service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:49.577081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:49.577953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:49.578243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:49.578524 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] PATH_INFO: `/v3/users/7b74548eae634d76a23e3cc7c2009ca3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:49.579709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b74548eae634d76a23e3cc7c2009ca3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:49.581698 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:49.817681 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:49.823823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b74548eae634d76a23e3cc7c2009ca3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.835281 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b74548eae634d76a23e3cc7c2009ca3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.836002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b74548eae634d76a23e3cc7c2009ca3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.837126 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b74548eae634d76a23e3cc7c2009ca3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.923956 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-357a57fb-e200-4a6a-b9a4-6ef3f7825010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b74548eae634d76a23e3cc7c2009ca3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:49.937431 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1418/2849] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:49 2022] DELETE /identity/v3/users/7b74548eae634d76a23e3cc7c2009ca3 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:26:50.365837 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:50.367436 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:50.380815 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c023-435f-4751-a75c-89537bc9be3b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:50.422843 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:50.440923 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:50.443468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:50.443468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:50.443468 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] PATH_INFO: `/v3/projects/5efd2933d8e3438b8007bdb0fb2b7029` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:50.443833 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efd2933d8e3438b8007bdb0fb2b7029)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:50.445548 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:50.572551 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efd2933d8e3438b8007bdb0fb2b7029', 'request_id': 'req-313962df-f20b-4f2d-ae1a-beb7b26ff031'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:50.578554 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efd2933d8e3438b8007bdb0fb2b7029', 'request_id': 'req-313962df-f20b-4f2d-ae1a-beb7b26ff031'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:50.583880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efd2933d8e3438b8007bdb0fb2b7029', 'request_id': 'req-313962df-f20b-4f2d-ae1a-beb7b26ff031'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:50.673231 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] The token cache is being invalidate because project 5efd2933d8e3438b8007bdb0fb2b7029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:26:50.673466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:50.674083 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-313962df-f20b-4f2d-ae1a-beb7b26ff031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:50.675620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1432/2850] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:26:50 2022] DELETE /identity/v3/projects/5efd2933d8e3438b8007bdb0fb2b7029 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:50.680682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:50.681182 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:50.681303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:50.699575 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:50.700795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:50.757903 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1419/2851] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:50.767480 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:50.767766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:50.768081 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:50.786630 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:50.787831 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:50.795674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1433/2852] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:50.799740 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:50.809550 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903744-387d-4ca2-9824-340bf9af0e3a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:50.814108 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:50.814753 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:50.815036 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:50.815337 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:50.816096 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:26:50.816406 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:50.818018 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:50.829802 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1420/2853] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:26:50.833824 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:50.843699 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44671-1b69-4c1f-87bc-cbebcb829d63 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:50.848283 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:50.848952 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:50.849232 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:50.849524 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:50.850181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:50.852383 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:50.933012 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1434/2854] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:26:50 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:50.937229 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:50.948157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a177-069d-49aa-a3ac-f62a49899f5e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:51.002776 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:51.003430 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:51.003712 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:51.004017 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:51.004704 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:51.006619 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:51.090947 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1421/2855] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:26:50 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:26:51.094941 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:51.105412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1f747-f1ae-48ed-993a-60f9f4fe94b8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:51.110150 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:51.110835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:51.111119 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:51.111398 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:51.112233 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:51.113807 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:51.124674 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1435/2856] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:51.128799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:51.139297 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef9a8a-20cd-4d1c-998d-86454c698972 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:51.143823 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9037a-3063-4737-be30-072c33c4ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:51.144476 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9037a-3063-4737-be30-072c33c4ef3c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:51.144758 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9037a-3063-4737-be30-072c33c4ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:51.145032 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9037a-3063-4737-be30-072c33c4ef3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:51.145747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9037a-3063-4737-be30-072c33c4ef3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:51.147339 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9037a-3063-4737-be30-072c33c4ef3c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:51.157719 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1422/2857] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:26:51.161975 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:51.172157 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4a83-d9cc-46dc-8ff4-39e3a6d2355f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:51.176696 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:51.177577 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:51.177847 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:51.178123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] PATH_INFO: `/v3/projects/5bcc7fbfcfd7479d80cdff6cb52a43d8/users/0de32eb9e1984b019e369508d7cf5f42/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:51.192872 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcc7fbfcfd7479d80cdff6cb52a43d8, user_id=0de32eb9e1984b019e369508d7cf5f42, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:51.195432 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:51.279644 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1436/2858] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:26:51 2022] PUT /identity/v3/projects/5bcc7fbfcfd7479d80cdff6cb52a43d8/users/0de32eb9e1984b019e369508d7cf5f42/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:51.290268 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:51.290558 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:51.290833 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:51.318064 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] MFA Rules not processed for user `0de32eb9e1984b019e369508d7cf5f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:51.319264 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:51.328112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:51.384585 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1423/2859] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:51.396041 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:51.397768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:51.474826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:26:51.477818 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e984bdd-2461-4eff-b573-b88cc7f435e3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:51.481506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62fe38a03ef04a2baa5ec228d6a8cf97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:51.482149 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:51.482431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:51.482703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:51.490835 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:51.494857 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:51.502177 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1437/2860] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:58.968071 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:58.973556 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:59.041152 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743179ee-caa6-4e65-a2e6-2eaec7f155e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:59.046642 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:59.047291 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:59.047576 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:59.047881 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:59.049663 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:59.064006 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:59.066901 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec7db-5bca-42be-843c-625eb758a5cd service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:59.077114 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1424/2861] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:26:59.200538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:59.266038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3143fe3-5497-487d-b11f-7c3346a04c2b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:59.270907 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:59.271838 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:59.272127 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:59.272400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] PATH_INFO: `/v3/users/0de32eb9e1984b019e369508d7cf5f42` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:59.273640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de32eb9e1984b019e369508d7cf5f42)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:59.275683 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:59.475946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de32eb9e1984b019e369508d7cf5f42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:59.488589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de32eb9e1984b019e369508d7cf5f42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:59.489273 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de32eb9e1984b019e369508d7cf5f42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:59.559425 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de32eb9e1984b019e369508d7cf5f42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:59.560078 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de32eb9e1984b019e369508d7cf5f42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:26:59.572810 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1438/2862] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:26:59 2022] DELETE /identity/v3/users/0de32eb9e1984b019e369508d7cf5f42 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:26:59.577360 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:59.577701 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:59.577981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:59.596809 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:26:59.598034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:59.656867 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1425/2863] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:26:59.667163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:26:59.669049 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:26:59.731346 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bd2e-8e0c-4c4a-9aab-38a648492c9b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:26:59.735074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:26:59.738879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:26:59.738879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:26:59.738879 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:26:59.746201 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:26:59.747634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:26:59.757379 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1439/2864] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:00.185193 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:00.187275 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:00.200702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a4d34-d539-4c05-8b45-5483db3be280 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:00.205747 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:00.207387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:00.207671 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:00.207981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] PATH_INFO: `/v3/projects/5bcc7fbfcfd7479d80cdff6cb52a43d8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:00.209164 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bcc7fbfcfd7479d80cdff6cb52a43d8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:00.211347 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:00.308594 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:00.320577 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bcc7fbfcfd7479d80cdff6cb52a43d8', 'request_id': 'req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:00.422240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bcc7fbfcfd7479d80cdff6cb52a43d8', 'request_id': 'req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:00.429002 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bcc7fbfcfd7479d80cdff6cb52a43d8', 'request_id': 'req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:00.440433 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] The token cache is being invalidate because project 5bcc7fbfcfd7479d80cdff6cb52a43d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:27:00.440756 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:00.441407 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:00.443323 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1426/2865] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:27:00 2022] DELETE /identity/v3/projects/5bcc7fbfcfd7479d80cdff6cb52a43d8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:27:08.000984 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:08.002404 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:08.016713 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:08.070636 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43d5cb-224f-44f2-b66f-e58df7886610 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:08.120095 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:08.121765 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:08.141181 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:08.141839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:08.142124 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:08.142401 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:08.144243 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:08.156868 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:08.158466 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:08.168888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1440/2866] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:27:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:08.193796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f9ad-f6db-4b53-953b-fa1e4c996ca1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:08.199657 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:08.200586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:08.200930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:08.201192 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] PATH_INFO: `/v3/users/a21f92d1ca604c0f9c93b81ed0904a08` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:08.202404 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21f92d1ca604c0f9c93b81ed0904a08)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:08.204541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:08.417772 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21f92d1ca604c0f9c93b81ed0904a08'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:08.429553 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21f92d1ca604c0f9c93b81ed0904a08'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:08.430221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21f92d1ca604c0f9c93b81ed0904a08'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:08.430890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21f92d1ca604c0f9c93b81ed0904a08'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:08.496434 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21f92d1ca604c0f9c93b81ed0904a08'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:08.508965 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1427/2867] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:27:08 2022] DELETE /identity/v3/users/a21f92d1ca604c0f9c93b81ed0904a08 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:27:08.519517 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:08.521050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:08.576735 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b9b3-4196-4b87-a1bc-dfd41070c250 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:08.624229 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:08.624885 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:08.625170 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:08.625448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:08.627193 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:08.640937 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:08.690396 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:08.691766 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:08.701384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1441/2868] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:08.938467 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:08.940755 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:08.953803 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77dd6f1-a1e5-4ac5-a365-3c631cb1b5f8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:08.958597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:08.959461 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:08.959739 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:08.960049 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] PATH_INFO: `/v3/projects/b866575bf960414ba6be2ac0fffe5e11` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:08.961218 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b866575bf960414ba6be2ac0fffe5e11)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:08.964245 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:09.081987 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:09.092228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b866575bf960414ba6be2ac0fffe5e11', 'request_id': 'req-888fb19a-6603-43e7-94d8-559f42a4d095'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.159081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b866575bf960414ba6be2ac0fffe5e11', 'request_id': 'req-888fb19a-6603-43e7-94d8-559f42a4d095'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.165635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b866575bf960414ba6be2ac0fffe5e11', 'request_id': 'req-888fb19a-6603-43e7-94d8-559f42a4d095'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.176784 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] The token cache is being invalidate because project b866575bf960414ba6be2ac0fffe5e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:27:09.177099 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.177722 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.179241 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1428/2869] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:27:08 2022] DELETE /identity/v3/projects/b866575bf960414ba6be2ac0fffe5e11 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:27:09.183717 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:09.198054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5bd5d-9855-45a0-b775-3de0a9fab7fd service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:09.254860 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:09.255744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:09.256064 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:09.256343 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] PATH_INFO: `/v3/users/3010e852a07741e4b7bcd79067654ecc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:09.257596 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3010e852a07741e4b7bcd79067654ecc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:09.260431 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:09.449088 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3010e852a07741e4b7bcd79067654ecc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.461123 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3010e852a07741e4b7bcd79067654ecc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.461803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3010e852a07741e4b7bcd79067654ecc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.525235 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3010e852a07741e4b7bcd79067654ecc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.525865 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c8187d13-e179-4968-9e1e-1548cc39f31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3010e852a07741e4b7bcd79067654ecc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:09.538589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1442/2870] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:27:09 2022] DELETE /identity/v3/users/3010e852a07741e4b7bcd79067654ecc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:27:09.795697 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:09.797363 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:09.811125 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fb19a-6603-43e7-94d8-559f42a4d095 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:09.870240 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:09.871112 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:09.871400 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:09.871682 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] PATH_INFO: `/v3/projects/196a016d0c6b40a2850415a2cd55f62a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:09.872902 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] RBAC: Authorizing `identity:delete_project(project_id=196a016d0c6b40a2850415a2cd55f62a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:09.874899 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:09.988631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196a016d0c6b40a2850415a2cd55f62a', 'request_id': 'req-39e72e79-315d-4041-9a86-f3e553e0878a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:10.073180 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196a016d0c6b40a2850415a2cd55f62a', 'request_id': 'req-39e72e79-315d-4041-9a86-f3e553e0878a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:10.079658 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196a016d0c6b40a2850415a2cd55f62a', 'request_id': 'req-39e72e79-315d-4041-9a86-f3e553e0878a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:10.090945 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] The token cache is being invalidate because project 196a016d0c6b40a2850415a2cd55f62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:27:10.091234 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:10.091911 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-39e72e79-315d-4041-9a86-f3e553e0878a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:27:10.093436 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1429/2871] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:27:09 2022] DELETE /identity/v3/projects/196a016d0c6b40a2850415a2cd55f62a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:27:10.098392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.098752 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.099097 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.117635 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:27:10.118880 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:10.144107 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:10.177803 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1443/2872] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:27:10.236763 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.237314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.237314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.255219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:27:10.256472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:10.264625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1430/2873] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:27:10.268703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.279036 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40290d9-658d-488d-869a-70c23d619a71 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.283650 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.284335 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.284622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.284900 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.285620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 24 10:27:10.285926 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.287529 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.299710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1444/2874] 10.222.0.44 () {58 vars in 1152 bytes} [Tue May 24 10:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 24 10:27:10.303855 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.313013 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25aab1-59eb-4875-9d33-794472dc1330 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.317597 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.318238 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.318522 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.318798 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.319481 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.321435 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.418314 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1431/2875] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:27:10 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:27:10.422392 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.432686 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b01e0-0635-493f-a934-b3e1dd3165f5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.489798 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.490467 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.490751 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.491028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.491710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.493694 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.588851 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1445/2876] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:27:10 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:27:10.593045 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.603565 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecbdce-bf4f-4c06-a22e-534915c86ff7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.608286 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.608940 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.609228 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.609501 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.610221 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.611847 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.623503 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1432/2877] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:27:10.627366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.637946 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e9402-34c3-4aca-994e-ef7ccafbdd77 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.642475 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb0fdf-c9c1-473a-bc63-98f9e27509a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.643125 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb0fdf-c9c1-473a-bc63-98f9e27509a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.643406 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb0fdf-c9c1-473a-bc63-98f9e27509a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.643681 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb0fdf-c9c1-473a-bc63-98f9e27509a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.644434 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb0fdf-c9c1-473a-bc63-98f9e27509a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.646023 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb0fdf-c9c1-473a-bc63-98f9e27509a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.658306 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1446/2878] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:27:10.663672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.673702 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dbfe1-6489-452b-857e-9ad35ff0a7d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.678249 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.679117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.679401 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.679680 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] PATH_INFO: `/v3/projects/f4e96acc60714f0589d31139a8bf23ca/users/6ff111c533394fc6af6ee0f7488a877b/roles/ee2edaaf7e5e4667880cd978b8cc1137` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.691022 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:10.694996 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e96acc60714f0589d31139a8bf23ca, user_id=6ff111c533394fc6af6ee0f7488a877b, role_id=ee2edaaf7e5e4667880cd978b8cc1137)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.698561 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.776635 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1433/2879] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:27:10 2022] PUT /identity/v3/projects/f4e96acc60714f0589d31139a8bf23ca/users/6ff111c533394fc6af6ee0f7488a877b/roles/ee2edaaf7e5e4667880cd978b8cc1137 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:27:10.781817 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad621f-1eef-4809-bfe9-ac2c0754d68f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.782242 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad621f-1eef-4809-bfe9-ac2c0754d68f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.782578 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad621f-1eef-4809-bfe9-ac2c0754d68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.800028 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d6ad621f-1eef-4809-bfe9-ac2c0754d68f None None] MFA Rules not processed for user `a8aea1f45aa44e67a635de02ad254222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:27:10.801228 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d6ad621f-1eef-4809-bfe9-ac2c0754d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:10.859736 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1447/2880] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:27:10.869614 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:10.871367 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:10.927243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cff7b-58e8-4450-8d46-c7f37800adfb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:10.930796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:10.932259 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:10.932554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:10.932834 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:10.941783 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:10.943227 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:10.953303 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1434/2881] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:15.960622 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:15.961508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:15.961826 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:15.995625 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] MFA Rules not processed for user `6ff111c533394fc6af6ee0f7488a877b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:27:15.997074 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:16.026320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:16.084801 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1448/2882] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:27:16.090157 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:16.100970 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408b92e-7022-4c84-92a0-ecdaa9f8f163 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:16.105926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:16.106708 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:16.107077 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:16.107419 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:16.108260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:16.110248 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:16.172980 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1435/2883] 10.222.0.44 () {60 vars in 1152 bytes} [Tue May 24 10:27:16 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:27:16.177169 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:16.189670 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717004d9-bc9b-4769-bd57-be0807134a67 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:16.249643 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:16.250327 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:16.250613 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:16.250893 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:16.251634 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:16.253679 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:16.326942 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1449/2884] 10.222.0.44 () {60 vars in 1143 bytes} [Tue May 24 10:27:16 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 24 10:27:16.331147 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:16.342610 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8548e-f22c-4444-9ed3-0956ac6c4569 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:16.347533 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:16.348283 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:16.348737 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:16.349023 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:16.349841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:16.351457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:16.363752 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1436/2885] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:27:16.368082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:16.379875 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1880f0f-6c1b-4484-a1e3-6ceed716a943 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:16.385326 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:16.389924 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:16.390222 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:16.390506 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] PATH_INFO: `/v3/projects/e4e38571eae4406f9b76bdbd598e92c7/users/6cc61620120d4600b7c79dfef9f8b8c8/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:16.406344 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e38571eae4406f9b76bdbd598e92c7, user_id=6cc61620120d4600b7c79dfef9f8b8c8, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:16.409114 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:16.477070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1450/2886] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:27:16 2022] PUT /identity/v3/projects/e4e38571eae4406f9b76bdbd598e92c7/users/6cc61620120d4600b7c79dfef9f8b8c8/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:27:16.486748 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:16.497838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbf8e-c70d-4296-a650-0458a6eb4986 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:16.555219 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476e451-ad43-40e9-bda3-33cd7f3faea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:16.555983 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e451-ad43-40e9-bda3-33cd7f3faea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:16.556511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e451-ad43-40e9-bda3-33cd7f3faea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:16.556796 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476e451-ad43-40e9-bda3-33cd7f3faea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:16.557513 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e451-ad43-40e9-bda3-33cd7f3faea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:16.559160 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476e451-ad43-40e9-bda3-33cd7f3faea8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:16.569502 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1437/2887] 10.222.0.44 () {58 vars in 1121 bytes} [Tue May 24 10:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 24 10:27:16.574640 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:16.585046 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b2d-b406-481b-bee0-fbab59de59a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:16.590055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:16.594412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:16.594412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:16.594412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] PATH_INFO: `/v3/projects/e4e38571eae4406f9b76bdbd598e92c7/users/6cc61620120d4600b7c79dfef9f8b8c8/roles/97df1e81848642bb9115cb9c5b5789ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:16.594412 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e38571eae4406f9b76bdbd598e92c7, user_id=6cc61620120d4600b7c79dfef9f8b8c8, role_id=97df1e81848642bb9115cb9c5b5789ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:16.596307 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:16.607381 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1451/2888] 10.222.0.44 () {60 vars in 1482 bytes} [Tue May 24 10:27:16 2022] PUT /identity/v3/projects/e4e38571eae4406f9b76bdbd598e92c7/users/6cc61620120d4600b7c79dfef9f8b8c8/roles/97df1e81848642bb9115cb9c5b5789ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:27:22.293926 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:22.294468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:22.294468 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:22.324113 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] MFA Rules not processed for user `6cc61620120d4600b7c79dfef9f8b8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:27:22.325320 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:22.379511 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:22.401497 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1438/2889] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:27:22.419495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:22.421437 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:22.510248 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b96d4-8c39-4431-b03d-64c3847aa26b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:22.515841 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dd22f-630a-4fb0-9c0c-5a9802efcedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:22.516508 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd22f-630a-4fb0-9c0c-5a9802efcedb service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:22.516790 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd22f-630a-4fb0-9c0c-5a9802efcedb service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:22.517068 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dd22f-630a-4fb0-9c0c-5a9802efcedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:22.531369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:22.577641 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dd22f-630a-4fb0-9c0c-5a9802efcedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:22.579369 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dd22f-630a-4fb0-9c0c-5a9802efcedb service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:22.589400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1452/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:27:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:28.271827 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:28.273214 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:28.370795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94358e-9f24-4f77-83ea-a82938e3c98d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:28.376310 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:28.376964 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:28.377351 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:28.377631 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:28.379620 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:28.393010 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:28.394608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:28.405370 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1439/2891] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:32.584592 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=20 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:38.400141 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=50 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:40.613620 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:40.614117 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:40.614239 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:40.631213 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] MFA Rules not processed for user `6ff111c533394fc6af6ee0f7488a877b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:27:40.632448 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:40.639183 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1453/2892] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:27:40.946117 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:27:40.947510 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:41.002795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff35a1-ee8f-43d2-b2ba-120e95c74796 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:27:41.006296 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:27:41.006930 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:27:41.007213 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:27:41.007487 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:27:41.009230 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:27:41.019146 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:27:41.020608 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:27:41.028795 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1440/2893] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:27:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:27:50.626384 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:51.025246 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=26 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:28:00.367709 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:28:00.377705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38c6cc-ca45-43fb-9b9d-00f44efe5f92 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:28:00.382488 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:28:00.383129 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:28:00.383421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:28:00.383698 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:28:00.392973 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:28:00.394456 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:28:00.403931 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1454/2894] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:28:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:28:10.399710 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:29:57.946643 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:29:57.955691 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ac9c-57d4-48e3-b155-1362373dd1de service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:29:57.959427 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:29:57.960097 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:29:57.960384 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:29:57.960664 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:29:57.962452 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:29:57.996841 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:29:57.998277 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2785-b659-484e-ab92-5ec6d6aeaed6 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:29:58.018592 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1441/2895] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:29:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:29:59.200214 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:29:59.208963 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbba39-86ab-4fe1-a8b7-865f57a5d9ce service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:29:59.212744 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:29:59.213639 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:29:59.213925 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:29:59.214205 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:29:59.216082 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:29:59.229516 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:29:59.231514 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:29:59.242298 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1455/2896] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:29:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:30:02.677318 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:30:02.677845 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:30:02.677951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:30:02.695343 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] MFA Rules not processed for user `6ff111c533394fc6af6ee0f7488a877b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:30:02.696579 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:30:02.704322 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1442/2897] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:30:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:30:03.657010 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:30:03.669765 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7464-3075-4f6b-bc7a-bd97acd3397a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:30:03.674703 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:30:03.675345 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:30:03.675629 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:30:03.675961 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:30:03.677705 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:30:03.690055 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:30:03.691633 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d2912-f95f-4511-835d-f2d5e202fb6e service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:30:03.702585 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1456/2898] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:30:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:30:06.336500 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:30:06.347874 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bc68b-c73a-435d-9c59-b33f3ed4de09 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:30:06.351571 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:30:06.352181 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:30:06.352466 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:30:06.352744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:30:06.354625 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:30:06.365743 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:30:06.371175 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:30:06.375587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1443/2899] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:30:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:30:13.697667 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=12 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:30:16.371586 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=27 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:31:51.940320 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:31:51.940908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:31:51.940908 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:31:51.958628 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] MFA Rules not processed for user `6ff111c533394fc6af6ee0f7488a877b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 24 10:31:51.959839 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:31:51.967421 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1457/2900] 10.222.0.44 () {58 vars in 957 bytes} [Tue May 24 10:31:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 24 10:32:01.953878 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:32:07.262058 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:32:07.276042 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde3cd1-7111-43a6-8e5f-e559ab8e3f6f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:32:07.282261 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:32:07.282900 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:32:07.283191 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:32:07.283469 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:32:07.285260 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:32:07.297371 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:32:07.298946 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:32:07.309387 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1444/2901] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:32:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:32:11.315927 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:32:11.329399 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e11534-dabc-411b-b5ad-97b893be30ce None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:32:11.335770 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:32:11.336513 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:32:11.336792 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:32:11.337071 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:32:11.338888 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:32:11.352357 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:32:11.353948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:32:11.365677 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1458/2902] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:32:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:32:17.304914 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:32:21.361589 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:32:33.237836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:32:33.249110 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d3ace-2108-4397-ac19-1041f3feda9e service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:32:33.254020 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:32:33.254646 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:32:33.254923 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:32:33.255197 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:32:33.263621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:32:33.265953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:32:33.275953 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1445/2903] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:32:43.271672 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:33:49.854511 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:33:49.863928 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7396c81-4771-461a-947d-feb677d0639f service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:33:49.867498 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:33:49.868237 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:33:49.868520 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:33:49.868797 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:33:49.877631 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:33:49.879085 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:33:49.888336 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1459/2904] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:33:58.140822 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:33:58.153520 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0bc19-b2d7-4a94-a5ef-f3fdaafb63b5 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:33:58.159189 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc6411c631a41d5a22ee51adca2b8f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:33:58.159890 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:33:58.160179 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:33:58.160457 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:33:58.162301 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:33:58.175859 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:33:58.177854 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:33:58.190235 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1446/2905] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:33:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:33:59.884077 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:34:04.187271 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:34:04.196198 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdfcb-b15b-4996-b647-6a8c4987bfe6 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:34:04.199813 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb8facb574a4935aa7fb390397c1cbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:34:04.200495 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:34:04.200787 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:34:04.201070 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:34:04.261741 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:34:04.263175 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:34:04.272795 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1460/2906] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:34:07.634846 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:34:07.646587 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261420ac-40e1-4309-9e84-cacfe11309f7 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:34:07.651709 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:34:07.652378 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:34:07.652799 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:34:07.653081 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:34:07.654836 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:34:07.666472 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:34:07.668085 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:34:07.678554 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1447/2907] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:34:11.278538 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:34:11.289682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93425d87-5d3e-4a94-a786-376310766a25 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:34:11.294405 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:34:11.295400 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:34:11.296410 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:34:11.296701 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] PATH_INFO: `/v3/users/6ff111c533394fc6af6ee0f7488a877b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:34:11.297989 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff111c533394fc6af6ee0f7488a877b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:34:11.300095 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:34:11.479995 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff111c533394fc6af6ee0f7488a877b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:11.492319 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff111c533394fc6af6ee0f7488a877b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:11.493007 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff111c533394fc6af6ee0f7488a877b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:11.563375 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff111c533394fc6af6ee0f7488a877b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:11.564043 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff111c533394fc6af6ee0f7488a877b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:11.576948 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1461/2908] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:34:11 2022] DELETE /identity/v3/users/6ff111c533394fc6af6ee0f7488a877b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:34:11.833951 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:34:11.848026 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441bdb-aab2-421f-81b5-ec5fb04252fc service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:34:11.907143 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:34:11.908037 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:34:11.908326 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:34:11.908602 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] PATH_INFO: `/v3/projects/f4e96acc60714f0589d31139a8bf23ca` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:34:11.909777 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e96acc60714f0589d31139a8bf23ca)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:34:11.911718 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:34:12.003201 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e96acc60714f0589d31139a8bf23ca', 'request_id': 'req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.060590 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e96acc60714f0589d31139a8bf23ca', 'request_id': 'req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.067034 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e96acc60714f0589d31139a8bf23ca', 'request_id': 'req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.078094 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] The token cache is being invalidate because project f4e96acc60714f0589d31139a8bf23ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:34:12.078541 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.079178 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.080767 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1448/2909] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:34:11 2022] DELETE /identity/v3/projects/f4e96acc60714f0589d31139a8bf23ca => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:34:12.084895 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:34:12.086324 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:34:12.100312 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faf5d9-bd72-4bb7-9ad5-4a4e78be99ac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:34:12.157852 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:34:12.158731 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:34:12.159020 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:34:12.159334 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] PATH_INFO: `/v3/users/6cc61620120d4600b7c79dfef9f8b8c8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:34:12.160564 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc61620120d4600b7c79dfef9f8b8c8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:34:12.162489 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:34:12.167761 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:34:12.325054 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc61620120d4600b7c79dfef9f8b8c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.338164 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc61620120d4600b7c79dfef9f8b8c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.338849 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc61620120d4600b7c79dfef9f8b8c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.408697 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc61620120d4600b7c79dfef9f8b8c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.409316 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc61620120d4600b7c79dfef9f8b8c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.421980 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1462/2910] 10.222.0.44 () {58 vars in 1223 bytes} [Tue May 24 10:34:12 2022] DELETE /identity/v3/users/6cc61620120d4600b7c79dfef9f8b8c8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 24 10:34:12.661505 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:34:12.662981 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:34:12.677563 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a395575-cdf0-4ff0-ae9e-a2dda3be9c2c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:34:12.735715 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8aea1f45aa44e67a635de02ad254222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fdda7d022db54add9754a061e49ddfb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:34:12.739638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:34:12.739638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:34:12.739638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] PATH_INFO: `/v3/projects/e4e38571eae4406f9b76bdbd598e92c7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:34:12.739638 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e38571eae4406f9b76bdbd598e92c7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:34:12.740243 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:34:12.746396 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:34:12.888818 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e38571eae4406f9b76bdbd598e92c7', 'request_id': 'req-c7490eab-409d-4552-884d-30a5bc7eb68e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.957183 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e38571eae4406f9b76bdbd598e92c7', 'request_id': 'req-c7490eab-409d-4552-884d-30a5bc7eb68e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.963591 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e38571eae4406f9b76bdbd598e92c7', 'request_id': 'req-c7490eab-409d-4552-884d-30a5bc7eb68e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.973838 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] The token cache is being invalidate because project e4e38571eae4406f9b76bdbd598e92c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 24 10:34:12.974120 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.974744 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7490eab-409d-4552-884d-30a5bc7eb68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 24 10:34:12.976287 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1449/2911] 10.222.0.44 () {58 vars in 1232 bytes} [Tue May 24 10:34:12 2022] DELETE /identity/v3/projects/e4e38571eae4406f9b76bdbd598e92c7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 24 10:34:22.418138 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:34:23.014621 dv-cinder-810457-9-iscsi devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:37:39.236682 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 24 10:37:39.238091 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:37:39.373561 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3e924-53a5-4dee-b4a1-7195e14d8cd2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 24 10:37:39.432105 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6db55e0a3baa4da1b2e1eba24a6a7e12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43fef3448c934a39802eb1a5c645c18c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 24 10:37:39.432764 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 24 10:37:39.433050 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 24 10:37:39.433325 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 24 10:37:39.435113 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 24 10:37:39.447366 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 24 10:37:39.449038 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7cf04-88a8-49b0-b3f4-bbe7d56c7395 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 24 10:37:39.459163 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1463/2912] 10.222.0.44 () {60 vars in 1365 bytes} [Tue May 24 10:37:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 24 10:37:49.454768 dv-cinder-810457-9-iscsi devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}